[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:23 dist-test-slave-jztv krb5kdc[14409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:23 dist-test-slave-jztv krb5kdc[14409](info): set up 2 sockets
Aug 09 15:40:23 dist-test-slave-jztv krb5kdc[14409](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 15:40:24.863448 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:24 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:24.998315 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:43355
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:43355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:25.118914 14425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:25.119242 14425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:25.119321 14425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:25.123445 14425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:25.123544 14425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:25.123580 14425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:25.123622 14425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:25.123656 14425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:25.129118 14425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:43355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:43355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:25.130353 14425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:25.131482 14425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:25.141036 14432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:25.141054 14437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.141115 14425 server_base.cc:1034] running on GCE node
W20260809 15:40:25.141175 14434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.141955 14425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:25.143186 14425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:25.144356 14425 hybrid_clock.cc:648] HybridClock initialized: now 1786290025144336 us; error 89 us; skew 500 ppm
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:25.147305 14425 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:25.148239 14425 webserver.cc:460] Webserver started at http://127.14.15.190:37829/ using document root <none> and password file <none>
I20260809 15:40:25.148803 14425 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:25.148864 14425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:25.149086 14425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:25.151311 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "fdbb3653674c452da8bbfa93f6ec7432"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "938a0a7efc0b82740402811579187c30"
server_key_iv: "a6898920bbf13de4b71b989e2861d35a"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.151929 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "fdbb3653674c452da8bbfa93f6ec7432"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "938a0a7efc0b82740402811579187c30"
server_key_iv: "a6898920bbf13de4b71b989e2861d35a"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.155891 14425 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:25.158514 14452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.159826 14425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:25.160003 14425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "fdbb3653674c452da8bbfa93f6ec7432"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "938a0a7efc0b82740402811579187c30"
server_key_iv: "a6898920bbf13de4b71b989e2861d35a"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.160135 14425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:25.179914 14425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:25.183427 14425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:25.183648 14425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:25.191530 14425 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:43355
I20260809 15:40:25.191560 14532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:43355 every 8 connection(s)
I20260809 15:40:25.192574 14425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:25.195559 14534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:25.199644 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14425
I20260809 15:40:25.199822 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:25.201534 14398 external_mini_cluster.cc:1428] Setting key b9a02054d621a85e2e28ab3f5332561a
I20260809 15:40:25.202519 14534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432: Bootstrap starting.
I20260809 15:40:25.205367 14534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:25.206291 14534 log.cc:824] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:25.208256 14534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432: No bootstrap required, opened a new log
I20260809 15:40:25.212370 14534 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } }
I20260809 15:40:25.212635 14534 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:25.212726 14534 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdbb3653674c452da8bbfa93f6ec7432, State: Initialized, Role: FOLLOWER
I20260809 15:40:25.213162 14534 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } }
I20260809 15:40:25.213315 14534 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:25.213400 14534 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:25.213521 14534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:25.214564 14534 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } }
I20260809 15:40:25.214922 14534 leader_election.cc:302] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdbb3653674c452da8bbfa93f6ec7432; no voters:
I20260809 15:40:25.215271 14534 leader_election.cc:288] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:25.215345 14540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:25.215550 14540 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [term 1 LEADER]: Becoming Leader. State: Replica: fdbb3653674c452da8bbfa93f6ec7432, State: Running, Role: LEADER
I20260809 15:40:25.215905 14540 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } }
I20260809 15:40:25.216605 14534 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:25.217780 14543 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdbb3653674c452da8bbfa93f6ec7432. Latest consensus state: current_term: 1 leader_uuid: "fdbb3653674c452da8bbfa93f6ec7432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } } }
I20260809 15:40:25.217943 14543 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:25.218351 14541 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdbb3653674c452da8bbfa93f6ec7432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbb3653674c452da8bbfa93f6ec7432" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 43355 } } }
I20260809 15:40:25.218436 14554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:25.218523 14541 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432 [sys.catalog]: This master's current role is: LEADER
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:25.222049 14554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:25.227466 14554 catalog_manager.cc:1347] Generated new cluster ID: 3ce3de1012714e7889968ef33754cf69
I20260809 15:40:25.227545 14554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:25.229099 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.205162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52604 (local address 127.14.15.190:43355)
0809 15:40:25.205757 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:25.205776 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:25.206977 (+ 1201us) server_negotiation.cc:407] Connection header received
0809 15:40:25.210522 (+ 3545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:25.210540 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:25.210837 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:25.211175 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:25.213497 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.214617 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.216191 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.216775 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.216955 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.222423 (+ 5468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:25.222430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:25.222445 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:25.222488 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:25.224714 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.225388 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.225395 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.225401 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.225555 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.226005 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.226008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.226010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.226587 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:25.226785 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:25.227763 (+ 978us) server_negotiation.cc:299] Negotiation successful
0809 15:40:25.228111 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":150,"threads_started":1}
I20260809 15:40:25.241384 14554 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:25.242470 14554 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:25.248382 14554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdbb3653674c452da8bbfa93f6ec7432: Generated new TSK 0
I20260809 15:40:25.249110 14554 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:25.286686 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:25.411983 14573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:25.412485 14573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:25.412576 14573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:25.419452 14573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:25.419556 14573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:25.419658 14573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:25.429395 14573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:25.431131 14573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:25.432662 14573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:25.445483 14580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:25.445489 14581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:25.445487 14583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.446097 14573 server_base.cc:1034] running on GCE node
I20260809 15:40:25.446593 14573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:25.447278 14573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:25.448446 14573 hybrid_clock.cc:648] HybridClock initialized: now 1786290025448416 us; error 43 us; skew 500 ppm
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:25.451457 14573 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:25.452422 14573 webserver.cc:460] Webserver started at http://127.14.15.129:44759/ using document root <none> and password file <none>
I20260809 15:40:25.453011 14573 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:25.453104 14573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:25.453342 14573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:25.455538 14573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "5478790cc6664f00b11906f615fd6539"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "a48be87c89172d833118c0e0137470d2"
server_key_iv: "d908f62fb43c03328206477e908a03c8"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.456115 14573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "5478790cc6664f00b11906f615fd6539"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "a48be87c89172d833118c0e0137470d2"
server_key_iv: "d908f62fb43c03328206477e908a03c8"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.459904 14573 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:25.462361 14594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.463665 14573 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:25.463809 14573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "5478790cc6664f00b11906f615fd6539"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "a48be87c89172d833118c0e0137470d2"
server_key_iv: "d908f62fb43c03328206477e908a03c8"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.463915 14573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:25.483850 14573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:25.487469 14573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:25.487648 14573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:25.488216 14573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:25.489044 14573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:25.489102 14573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.489144 14573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:25.489172 14573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.499079 14573 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:42451
I20260809 15:40:25.499101 14769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:42451 every 8 connection(s)
I20260809 15:40:25.500065 14573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:25.504700 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14573
I20260809 15:40:25.504817 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:25.505131 14398 external_mini_cluster.cc:1428] Setting key 8ea1c256a33d07a91b32eaca395e5af8
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:25.515982 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.502112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:49479 (local address 127.14.15.190:43355)
0809 15:40:25.502292 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:25.502296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:25.503113 (+ 817us) server_negotiation.cc:407] Connection header received
0809 15:40:25.504481 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:25.504486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:25.504551 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:25.504660 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:25.506122 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.506829 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.508009 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.508242 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.508361 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.511565 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:25.511568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:25.511570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:25.511592 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:25.513536 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.514109 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.514116 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.514119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.514254 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.514730 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.514733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.514735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.514947 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:25.515040 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:25.515738 (+ 698us) server_negotiation.cc:299] Negotiation successful
0809 15:40:25.515850 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:25.517153 14772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.502454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:43355 (local address 127.14.15.129:49479)
0809 15:40:25.502936 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:25.502980 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:25.504222 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:25.504851 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:25.504864 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:25.505346 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:25.505947 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.505965 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.506980 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.506983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.507853 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.507863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.508403 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.508407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.508583 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.509239 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:25.509264 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:25.511369 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:25.513682 (+ 2313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.513688 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.513700 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.513990 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.514385 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.514388 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.514391 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.514609 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.515073 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:25.515081 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:25.515417 (+ 336us) client_negotiation.cc:769] Sending connection context
0809 15:40:25.515662 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 15:40:25.516027 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":122,"threads_started":1}
I20260809 15:40:25.518551 14770 heartbeater.cc:347] Connected to a master server at 127.14.15.190:43355
I20260809 15:40:25.518767 14770 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:25.519289 14770 heartbeater.cc:511] Master 127.14.15.190:43355 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:25.520907 14481 ts_manager.cc:194] Registered new tserver with Master: 5478790cc6664f00b11906f615fd6539 (127.14.15.129:42451)
I20260809 15:40:25.522056 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:49479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:25.537580 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:25.654529 14776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:25.654806 14776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:25.654896 14776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:25.658906 14776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:25.658972 14776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:25.659098 14776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:25.664476 14776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:25.665581 14776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:25.666718 14776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:25.676600 14784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.676679 14776 server_base.cc:1034] running on GCE node
W20260809 15:40:25.676724 14783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:25.676633 14786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.677207 14776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:25.677840 14776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:25.679013 14776 hybrid_clock.cc:648] HybridClock initialized: now 1786290025678977 us; error 48 us; skew 500 ppm
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:25.682101 14776 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:25.683173 14776 webserver.cc:460] Webserver started at http://127.14.15.130:39935/ using document root <none> and password file <none>
I20260809 15:40:25.683864 14776 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:25.683962 14776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:25.684226 14776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:25.686970 14776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "1df9a18696fd4af8a2baeffdf8b61bf2"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "1ca7879ef70721a1e70a6fb74ac2cdee"
server_key_iv: "071128df4e592d9706e5c3571498a7bb"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.687592 14776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "1df9a18696fd4af8a2baeffdf8b61bf2"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "1ca7879ef70721a1e70a6fb74ac2cdee"
server_key_iv: "071128df4e592d9706e5c3571498a7bb"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.691439 14776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 15:40:25.694007 14793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.695467 14776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:40:25.695618 14776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "1df9a18696fd4af8a2baeffdf8b61bf2"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "1ca7879ef70721a1e70a6fb74ac2cdee"
server_key_iv: "071128df4e592d9706e5c3571498a7bb"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.695748 14776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:25.705681 14776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:25.708770 14776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:25.709007 14776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:25.709618 14776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:25.710568 14776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:25.710644 14776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.710716 14776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:25.710759 14776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.720183 14776 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:39551
I20260809 15:40:25.720203 14974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:39551 every 8 connection(s)
I20260809 15:40:25.721082 14776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:25.725436 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14776
I20260809 15:40:25.725591 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:25.725885 14398 external_mini_cluster.cc:1428] Setting key 368dadb4dd2d0b8bcd20459d60e8e7c4
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:25.736696 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.722996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:35733 (local address 127.14.15.190:43355)
0809 15:40:25.723155 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:25.723159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:25.724085 (+ 926us) server_negotiation.cc:407] Connection header received
0809 15:40:25.725416 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:25.725420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:25.725471 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:25.725614 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:25.726994 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.727664 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.729446 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.729852 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.729988 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.732556 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:25.732564 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:25.732570 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:25.732623 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:25.734328 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.735038 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.735041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.735043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.735121 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.735537 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.735539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.735540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.735719 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:25.735795 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:25.736467 (+ 672us) server_negotiation.cc:299] Negotiation successful
0809 15:40:25.736573 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:40:25.737996 14979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.723449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:43355 (local address 127.14.15.130:35733)
0809 15:40:25.723908 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:25.723958 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:25.725127 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:25.725804 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:25.725812 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:25.726332 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:25.726852 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.726866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.727815 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.727818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.729309 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.729325 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.730011 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.730014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.730158 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.730848 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:25.730864 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:25.732332 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:25.734450 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.734458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.734477 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.734897 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.735224 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.735230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.735234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.735437 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.735833 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:25.735840 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:25.736191 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 15:40:25.736433 (+ 242us) client_negotiation.cc:240] Negotiation successful
0809 15:40:25.736812 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":104,"threads_started":1}
I20260809 15:40:25.739282 14976 heartbeater.cc:347] Connected to a master server at 127.14.15.190:43355
I20260809 15:40:25.739540 14976 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:25.740024 14976 heartbeater.cc:511] Master 127.14.15.190:43355 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:25.741187 14481 ts_manager.cc:194] Registered new tserver with Master: 1df9a18696fd4af8a2baeffdf8b61bf2 (127.14.15.130:39551)
I20260809 15:40:25.741777 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:35733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:25.757546 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:25.877780 14982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:25.878053 14982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:25.878099 14982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:25.882323 14982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:25.882396 14982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:25.882462 14982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:25.887991 14982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:43355
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:25.889130 14982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:25.890180 14982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:25.900601 14990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:25.900575 14994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.900658 14982 server_base.cc:1034] running on GCE node
W20260809 15:40:25.900559 14997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:25.901286 14982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:25.901965 14982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:25.903160 14982 hybrid_clock.cc:648] HybridClock initialized: now 1786290025903134 us; error 46 us; skew 500 ppm
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:25.905946 14982 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:25.906895 14982 webserver.cc:460] Webserver started at http://127.14.15.131:38585/ using document root <none> and password file <none>
I20260809 15:40:25.907433 14982 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:25.907491 14982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:25.907675 14982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:25.909893 14982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "388b0347eec346f8aa55bd1898cc381d"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "8c266ed3965a2bf4c636888d2796e8ca"
server_key_iv: "4afd1c6e894703e588995d8d1be9dac0"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.910579 14982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "388b0347eec346f8aa55bd1898cc381d"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "8c266ed3965a2bf4c636888d2796e8ca"
server_key_iv: "4afd1c6e894703e588995d8d1be9dac0"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.914613 14982 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:25.917300 15008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.918936 14982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:25.919087 14982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "388b0347eec346f8aa55bd1898cc381d"
format_stamp: "Formatted at 2026-08-09 15:40:25 on dist-test-slave-jztv"
server_key: "8c266ed3965a2bf4c636888d2796e8ca"
server_key_iv: "4afd1c6e894703e588995d8d1be9dac0"
server_key_version: "encryptionkey@0"
I20260809 15:40:25.919212 14982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:25.942770 14982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:25.945693 14982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:25.945917 14982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:25.946563 14982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:25.947417 14982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:25.947465 14982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.947539 14982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:25.947575 14982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:25.957139 14982 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:38299
I20260809 15:40:25.957166 15193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:38299 every 8 connection(s)
I20260809 15:40:25.958024 14982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:25.965534 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14982
I20260809 15:40:25.965668 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:25.965946 14398 external_mini_cluster.cc:1428] Setting key a60c44f9bc7001deec1ca2a70dbcc2e0
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:25.972064 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.960013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:37203 (local address 127.14.15.190:43355)
0809 15:40:25.960160 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:25.960164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:25.960939 (+ 775us) server_negotiation.cc:407] Connection header received
0809 15:40:25.962512 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:25.962516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:25.962587 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:25.962694 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:25.963859 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.964389 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.965571 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.965894 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.966010 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.968841 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:25.968844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:25.968846 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:25.968870 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:25.970074 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.970668 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.970671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.970672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.970746 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:25.971088 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:25.971090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:25.971091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:25.971258 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:25.971331 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:25.971779 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 15:40:25.971903 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:40:25.972774 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.960325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:43355 (local address 127.14.15.131:37203)
0809 15:40:25.960792 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:25.960832 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:25.962308 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:25.962863 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:25.962870 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:25.963248 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:25.963707 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.963720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.964524 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.964528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.965419 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:25.965431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:25.966058 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:25.966063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:25.966297 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:25.966939 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:25.966962 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:25.968647 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:25.970209 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.970286 (+ 77us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.970298 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.970570 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.970849 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:25.970852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:25.970853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:25.970997 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:25.971343 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:25.971348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:25.971572 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 15:40:25.971716 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 15:40:25.971951 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":134,"threads_started":1}
I20260809 15:40:25.973860 15194 heartbeater.cc:347] Connected to a master server at 127.14.15.190:43355
I20260809 15:40:25.974100 15194 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:25.974608 15194 heartbeater.cc:511] Master 127.14.15.190:43355 requested a full tablet report, sending...
I20260809 15:40:25.975600 14481 ts_manager.cc:194] Registered new tserver with Master: 388b0347eec346f8aa55bd1898cc381d (127.14.15.131:38299)
I20260809 15:40:25.976158 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:37203
I20260809 15:40:25.980466 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:40:25 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:26.009128 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:25.999143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58814 (local address 127.14.15.129:42451)
0809 15:40:25.999473 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:25.999494 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:25.999523 (+ 29us) server_negotiation.cc:407] Connection header received
0809 15:40:25.999698 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:25.999706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:25.999910 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:26.000069 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:26.000895 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:26.001774 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:26.002702 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:26.003080 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:26.003209 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:26.005784 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:26.005792 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:26.005806 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:26.005829 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:26.007515 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:26.007924 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:26.007928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:26.007930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:26.008010 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:26.008256 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:26.008259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:26.008260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:26.008512 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:26.008680 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:26.008844 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:40:26.008972 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
W20260809 15:40:26.010267 14635 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58814
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[14409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[14409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:26.037263 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:26.029170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.14.15.129:42451)
0809 15:40:26.029357 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:26.029361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:26.029430 (+ 69us) server_negotiation.cc:407] Connection header received
0809 15:40:26.029550 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:26.029553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:26.029594 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:26.029663 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:26.030423 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:26.030925 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:26.031767 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:26.031987 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:26.032078 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:26.034374 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:26.034377 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:26.034379 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:26.034401 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:26.035834 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:26.036189 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:26.036192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:26.036193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:26.036267 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:26.036488 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:26.036490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:26.036491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:26.036644 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:26.036737 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:26.036937 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 15:40:26.037037 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 15:40:26.038537 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14573
I20260809 15:40:26.050973 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14776
I20260809 15:40:26.067034 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14982
I20260809 15:40:26.088853 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14425
2026-08-09T15:40:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2485 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[15215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[15215](info): set up 2 sockets
Aug 09 15:40:26 dist-test-slave-jztv krb5kdc[15215](info): commencing operation
krb5kdc: starting...
W20260809 15:40:27.328359 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:27 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:27.467141 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:37543
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:37543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:27.581380 15243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:27.581758 15243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:27.581847 15243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:27.585947 15243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:27.586073 15243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:27.586110 15243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:27.586148 15243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:27.586179 15243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:27.591856 15243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:37543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:37543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:27.593132 15243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:27.594580 15243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:27.604081 15254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:27.604076 15251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:27.604076 15250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:27.604288 15243 server_base.cc:1034] running on GCE node
I20260809 15:40:27.604962 15243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:27.606172 15243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:27.607446 15243 hybrid_clock.cc:648] HybridClock initialized: now 1786290027607395 us; error 62 us; skew 500 ppm
Aug 09 15:40:27 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:27.614353 15243 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:27.615410 15243 webserver.cc:460] Webserver started at http://127.14.15.190:42723/ using document root <none> and password file <none>
I20260809 15:40:27.616050 15243 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:27.616117 15243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:27.616345 15243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:27.618634 15243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "aef8212b57fd4e56b337897a35c96f85"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "11d130a532cd4216c016106ff5885b44"
server_key_iv: "aeb925240165101074e2124cbdb61f04"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.619221 15243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "aef8212b57fd4e56b337897a35c96f85"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "11d130a532cd4216c016106ff5885b44"
server_key_iv: "aeb925240165101074e2124cbdb61f04"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.623245 15243 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:27.626025 15263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:27.627480 15243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:40:27.627661 15243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "aef8212b57fd4e56b337897a35c96f85"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "11d130a532cd4216c016106ff5885b44"
server_key_iv: "aeb925240165101074e2124cbdb61f04"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.627799 15243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:27.642882 15243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:27.646091 15243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:27.646337 15243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:27.653995 15243 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:37543
I20260809 15:40:27.654021 15335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:37543 every 8 connection(s)
I20260809 15:40:27.655189 15243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:27.658528 15336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:27.664110 15336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85: Bootstrap starting.
I20260809 15:40:27.665112 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15243
I20260809 15:40:27.665249 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:27.665542 14398 external_mini_cluster.cc:1428] Setting key 3bfb1a8f18e7683cea3c3a45dfa2716e
I20260809 15:40:27.666899 15336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:27.667835 15336 log.cc:824] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:27.670048 15336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85: No bootstrap required, opened a new log
I20260809 15:40:27.674055 15336 raft_consensus.cc:348] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } }
I20260809 15:40:27.674343 15336 raft_consensus.cc:374] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:27.674423 15336 raft_consensus.cc:729] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8212b57fd4e56b337897a35c96f85, State: Initialized, Role: FOLLOWER
I20260809 15:40:27.674896 15336 consensus_queue.cc:260] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } }
Aug 09 15:40:27 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:27.675058 15336 raft_consensus.cc:388] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:27.675148 15336 raft_consensus.cc:482] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:27.675254 15336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:27.676465 15336 raft_consensus.cc:504] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } }
I20260809 15:40:27.676887 15336 leader_election.cc:302] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aef8212b57fd4e56b337897a35c96f85; no voters:
I20260809 15:40:27.677268 15336 leader_election.cc:288] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:27.677394 15343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:27.677695 15343 raft_consensus.cc:686] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [term 1 LEADER]: Becoming Leader. State: Replica: aef8212b57fd4e56b337897a35c96f85, State: Running, Role: LEADER
I20260809 15:40:27.678009 15343 consensus_queue.cc:237] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } }
I20260809 15:40:27.678673 15336 sys_catalog.cc:564] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:27.679842 15347 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aef8212b57fd4e56b337897a35c96f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } } }
I20260809 15:40:27.679975 15347 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:27.680284 15346 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aef8212b57fd4e56b337897a35c96f85. Latest consensus state: current_term: 1 leader_uuid: "aef8212b57fd4e56b337897a35c96f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef8212b57fd4e56b337897a35c96f85" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37543 } } }
I20260809 15:40:27.680382 15346 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:27.680644 15355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:27.681809 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:27.666805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32820 (local address 127.14.15.190:37543)
0809 15:40:27.667334 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:27.667352 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:27.667395 (+ 43us) server_negotiation.cc:407] Connection header received
0809 15:40:27.668304 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:27.668324 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:27.668694 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:27.669061 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:27.669752 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.671226 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.672068 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.672864 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.673072 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:27.675733 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:27.675739 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:27.675755 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:27.675787 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:27.677924 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:27.678465 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:27.678472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:27.678478 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:27.678618 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:27.678946 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:27.678950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:27.678951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:27.679532 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:27.679748 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:27.680750 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0809 15:40:27.681108 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":189,"threads_started":1}
I20260809 15:40:27.683681 15355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:27.689416 15355 catalog_manager.cc:1347] Generated new cluster ID: b17f03825db34343b2e5e16666ec8355
I20260809 15:40:27.689510 15355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:27.701900 15355 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:27.702961 15355 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:27.707082 15355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aef8212b57fd4e56b337897a35c96f85: Generated new TSK 0
I20260809 15:40:27.707743 15355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:27.749006 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:27.863713 15372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:27.864010 15372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:27.864087 15372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:27.868134 15372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:27.868217 15372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:27.868305 15372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:27.873654 15372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:27.874763 15372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:27.875840 15372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:27.885860 15383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:27.885998 15372 server_base.cc:1034] running on GCE node
W20260809 15:40:27.885890 15381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:27.885860 15379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:27.886705 15372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:27.887324 15372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:27.888499 15372 hybrid_clock.cc:648] HybridClock initialized: now 1786290027888473 us; error 40 us; skew 500 ppm
Aug 09 15:40:27 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:27.891505 15372 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:27.892486 15372 webserver.cc:460] Webserver started at http://127.14.15.129:43583/ using document root <none> and password file <none>
I20260809 15:40:27.893074 15372 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:27.893169 15372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:27.893416 15372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:27.895596 15372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "f60517c1cac74f70aff5ab1c1d21f537"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "96670ac0ffb39bf4c199c18ee4b68339"
server_key_iv: "f456d8352fd1682e15d783c13260d2c7"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.896204 15372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "f60517c1cac74f70aff5ab1c1d21f537"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "96670ac0ffb39bf4c199c18ee4b68339"
server_key_iv: "f456d8352fd1682e15d783c13260d2c7"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.900012 15372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 15:40:27.902488 15396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:27.903703 15372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:27.903846 15372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "f60517c1cac74f70aff5ab1c1d21f537"
format_stamp: "Formatted at 2026-08-09 15:40:27 on dist-test-slave-jztv"
server_key: "96670ac0ffb39bf4c199c18ee4b68339"
server_key_iv: "f456d8352fd1682e15d783c13260d2c7"
server_key_version: "encryptionkey@0"
I20260809 15:40:27.903959 15372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:27.929239 15372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:27.932718 15372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:27.932936 15372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:27.933570 15372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:27.934496 15372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:27.934577 15372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:27.934650 15372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:27.934701 15372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:27.944032 15372 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:33825
I20260809 15:40:27.944059 15554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:33825 every 8 connection(s)
I20260809 15:40:27.944968 15372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:27.946465 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15372
I20260809 15:40:27.946594 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:27.946911 14398 external_mini_cluster.cc:1428] Setting key bc4d20ead599b1deebb3eba4ce9ca913
Aug 09 15:40:27 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:27.960115 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:27.946851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:45205 (local address 127.14.15.190:37543)
0809 15:40:27.947027 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:27.947032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:27.948004 (+ 972us) server_negotiation.cc:407] Connection header received
0809 15:40:27.949036 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:27.949043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:27.949106 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:27.949199 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:27.950437 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.951075 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.952627 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.953061 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.953184 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:27.956047 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:27.956051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:27.956054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:27.956086 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:27.957781 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:27.958370 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:27.958377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:27.958379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:27.958469 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:27.958843 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:27.958846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:27.958848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:27.959041 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:27.959166 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:27.959787 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 15:40:27.959923 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 15:40:27.960971 15559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:27.947271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:37543 (local address 127.14.15.129:45205)
0809 15:40:27.947826 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:27.947884 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:27.948822 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:27.949363 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:27.949369 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:27.949731 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:27.950273 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:27.950293 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.951211 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.951217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:27.952486 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:27.952497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:27.953208 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:27.953211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:27.953357 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:27.954032 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:27.954048 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:27.955859 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:27.957905 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:27.957910 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:27.957922 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:27.958207 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:27.958586 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:27.958589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:27.958596 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:27.958733 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:27.959164 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:27.959172 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:27.959512 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 15:40:27.959725 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 15:40:27.960055 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":157,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:27.962327 15556 heartbeater.cc:347] Connected to a master server at 127.14.15.190:37543
I20260809 15:40:27.962581 15556 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:27.963167 15556 heartbeater.cc:511] Master 127.14.15.190:37543 requested a full tablet report, sending...
I20260809 15:40:27.964896 15287 ts_manager.cc:194] Registered new tserver with Master: f60517c1cac74f70aff5ab1c1d21f537 (127.14.15.129:33825)
I20260809 15:40:27.966032 15287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:45205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:27.981364 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:28.095953 15562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:28.096215 15562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:28.096257 15562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:28.100310 15562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:28.100365 15562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:28.100459 15562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:28.105659 15562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:28.106788 15562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:28.107870 15562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:28.117730 15569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:28.117715 15568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:28.117744 15572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:28.118285 15562 server_base.cc:1034] running on GCE node
I20260809 15:40:28.118644 15562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:28.119270 15562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:28.120422 15562 hybrid_clock.cc:648] HybridClock initialized: now 1786290028120390 us; error 44 us; skew 500 ppm
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:28.123150 15562 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:28.124073 15562 webserver.cc:460] Webserver started at http://127.14.15.130:43633/ using document root <none> and password file <none>
I20260809 15:40:28.124639 15562 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:28.124732 15562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:28.124970 15562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:28.127171 15562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "0fc9ec798d3e45db943d269560a031d0"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "05052818fb468c8f93779d516ae260fa"
server_key_iv: "40bc956b2c0aabc1a0e4dfe578b1bc74"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.127755 15562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "0fc9ec798d3e45db943d269560a031d0"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "05052818fb468c8f93779d516ae260fa"
server_key_iv: "40bc956b2c0aabc1a0e4dfe578b1bc74"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.131671 15562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:28.134160 15582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.135427 15562 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:28.135576 15562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "0fc9ec798d3e45db943d269560a031d0"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "05052818fb468c8f93779d516ae260fa"
server_key_iv: "40bc956b2c0aabc1a0e4dfe578b1bc74"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.135699 15562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:28.149610 15562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:28.152381 15562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:28.152596 15562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:28.153165 15562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:28.153980 15562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:28.154054 15562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.154122 15562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:28.154172 15562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.163318 15562 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:34511
I20260809 15:40:28.163353 15752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:34511 every 8 connection(s)
I20260809 15:40:28.164186 15562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:28.168452 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15562
I20260809 15:40:28.168593 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:28.168926 14398 external_mini_cluster.cc:1428] Setting key 2f2f0232d16ca6a5b95db77b40c84ad0
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:28.179949 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.166055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:34259 (local address 127.14.15.190:37543)
0809 15:40:28.166204 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.166221 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.167183 (+ 962us) server_negotiation.cc:407] Connection header received
0809 15:40:28.167990 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.167992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.168042 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.168116 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.169745 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.170492 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.172209 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.172417 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.172548 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.175420 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.175427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.175433 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.175466 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.177426 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.178136 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.178139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.178140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.178274 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.178705 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.178708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.178709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.178887 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.178966 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.179730 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.179829 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:40:28.181242 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.166386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:37543 (local address 127.14.15.130:34259)
0809 15:40:28.167034 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.167072 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.167821 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.168339 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.168349 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.169060 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:28.169619 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.169633 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.170642 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.170646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.172070 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.172086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.172608 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.172614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.172850 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.173493 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:28.173517 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:28.175238 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:28.177570 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:28.177579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:28.177598 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:28.178016 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:28.178378 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:28.178384 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:28.178388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:28.178595 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:28.179017 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:28.179024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:28.179445 (+ 421us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.179679 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.180147 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:40:28.182540 15753 heartbeater.cc:347] Connected to a master server at 127.14.15.190:37543
I20260809 15:40:28.182797 15753 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:28.183342 15753 heartbeater.cc:511] Master 127.14.15.190:37543 requested a full tablet report, sending...
I20260809 15:40:28.184545 15287 ts_manager.cc:194] Registered new tserver with Master: 0fc9ec798d3e45db943d269560a031d0 (127.14.15.130:34511)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:28.185289 15287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:34259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:28.202481 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:28.319980 15760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:28.320250 15760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:28.320343 15760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:28.324472 15760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:28.324543 15760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:28.324653 15760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:28.330054 15760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:37543
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:28.331265 15760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:28.332365 15760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:28.342525 15772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:28.342538 15771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:28.342679 15760 server_base.cc:1034] running on GCE node
W20260809 15:40:28.342866 15775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:28.343384 15760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:28.344074 15760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:28.345280 15760 hybrid_clock.cc:648] HybridClock initialized: now 1786290028345260 us; error 28 us; skew 500 ppm
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:28.348217 15760 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:28.349181 15760 webserver.cc:460] Webserver started at http://127.14.15.131:38521/ using document root <none> and password file <none>
I20260809 15:40:28.349745 15760 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:28.349809 15760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:28.349998 15760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:28.352241 15760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "9659dcf5e82743779146a58081957f7c"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "73f003988660df472201e0bda6ce706e"
server_key_iv: "a2986ff4b8fa4db61f3ce34c4466f799"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.352804 15760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "9659dcf5e82743779146a58081957f7c"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "73f003988660df472201e0bda6ce706e"
server_key_iv: "a2986ff4b8fa4db61f3ce34c4466f799"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.356796 15760 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:40:28.359417 15786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.360842 15760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:40:28.360996 15760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "9659dcf5e82743779146a58081957f7c"
format_stamp: "Formatted at 2026-08-09 15:40:28 on dist-test-slave-jztv"
server_key: "73f003988660df472201e0bda6ce706e"
server_key_iv: "a2986ff4b8fa4db61f3ce34c4466f799"
server_key_version: "encryptionkey@0"
I20260809 15:40:28.361112 15760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:28.375954 15760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:28.379220 15760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:28.379469 15760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:28.380121 15760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:28.381094 15760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:28.381146 15760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.381188 15760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:28.381242 15760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:28.390684 15760 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:44031
I20260809 15:40:28.390791 15950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:44031 every 8 connection(s)
I20260809 15:40:28.391698 15760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:28.399927 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15760
I20260809 15:40:28.400072 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:28.400379 14398 external_mini_cluster.cc:1428] Setting key 59da29b2ac4af56d082bca978ce45a44
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:28.405617 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.393669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39655 (local address 127.14.15.190:37543)
0809 15:40:28.393850 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.393854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.394776 (+ 922us) server_negotiation.cc:407] Connection header received
0809 15:40:28.395632 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.395635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.395683 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.395760 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.396951 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.397473 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.398653 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.398877 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.399006 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.401964 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.401968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.401973 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.402007 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.403572 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.404124 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.404127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.404128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.404205 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.404593 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.404596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.404597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.404782 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.404876 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.405390 (+ 514us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.405489 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 15:40:28.406589 15954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.394050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:37543 (local address 127.14.15.131:39655)
0809 15:40:28.394615 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.394657 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.395433 (+ 776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.395957 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.395963 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.396312 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:28.396818 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.396831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.397594 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.397596 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.398548 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.398558 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.399052 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.399056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.399224 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.399876 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:28.399900 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:28.401792 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:28.403701 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:28.403707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:28.403721 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:28.404025 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:28.404292 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:28.404294 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:28.404296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:28.404468 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:28.404892 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:28.404898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:28.405155 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.405325 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.405599 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":180,"threads_started":1}
I20260809 15:40:28.407855 15951 heartbeater.cc:347] Connected to a master server at 127.14.15.190:37543
I20260809 15:40:28.408162 15951 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:28.408710 15951 heartbeater.cc:511] Master 127.14.15.190:37543 requested a full tablet report, sending...
I20260809 15:40:28.409780 15287 ts_manager.cc:194] Registered new tserver with Master: 9659dcf5e82743779146a58081957f7c (127.14.15.131:44031)
I20260809 15:40:28.410435 15287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:39655
I20260809 15:40:28.414731 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:40:28.426292 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.418653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.14.15.190:37543)
0809 15:40:28.418840 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.418844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.419033 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:40:28.419200 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.419204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.419254 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.419345 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.420119 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.420647 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.421508 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.421724 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.421832 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.423299 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.423302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.423304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.423327 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.424598 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.425068 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.425070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.425071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.425143 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.425424 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.425426 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.425427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.425649 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.425754 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.426014 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.426108 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 15:40:28.431489 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:28.434698 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:28.449442 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.443286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60116 (local address 127.14.15.129:33825)
0809 15:40:28.443914 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.443932 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.443957 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:40:28.444053 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.444062 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.444282 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.444464 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:28.444785 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.445832 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.447778 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448620 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448998 (+ 378us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.449131 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.449188 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.449287 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":85,"threads_started":1}
I20260809 15:40:28.449455 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.443186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:33825 (local address 127.0.0.1:60116)
0809 15:40:28.443527 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.443571 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.443696 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.444450 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.444456 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.444479 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:28.444637 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.444645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.446111 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.446115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.447620 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.447634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448764 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.448919 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.449040 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.449149 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.449309 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":93,"thread_start_us":117,"threads_started":1}
I20260809 15:40:28.449513 15975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.443963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44892 (local address 127.14.15.130:34511)
0809 15:40:28.444389 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.444402 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.444424 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:40:28.444494 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.444511 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.444697 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.444851 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:28.445181 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.446319 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.447791 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448620 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448739 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.448889 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.449288 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.449373 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":123,"threads_started":1}
I20260809 15:40:28.449528 15978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.444368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.14.15.131:44031)
0809 15:40:28.445180 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.445192 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.445212 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:40:28.445284 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.445288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.445463 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.445623 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:28.445861 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.446789 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448071 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448610 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448740 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.448890 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.449303 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.449396 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":166,"threads_started":1}
I20260809 15:40:28.449894 15973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.443271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34511 (local address 127.0.0.1:44892)
0809 15:40:28.444167 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.444181 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.444274 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.444923 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.444926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.444939 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:28.445046 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.445052 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.446464 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.446467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.447661 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.447672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448943 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.449069 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.449090 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.449165 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.449731 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":494,"thread_start_us":98,"threads_started":1}
I20260809 15:40:28.449896 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.443921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:44031 (local address 127.0.0.1:53096)
0809 15:40:28.444718 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.444731 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.444820 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.445630 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.445634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.445653 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:28.445734 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.445740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.446932 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.446936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.447920 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.447930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.448741 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.448745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.448927 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.449082 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.449150 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.449767 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":595,"thread_start_us":118,"threads_started":1}
I20260809 15:40:28.452659 15866 tablet_service.cc:1467] Processing CreateTablet for tablet 0af766830e0b4f02b9d34ecc76d00afd (DEFAULT_TABLE table=test-table [id=e576f23cb15049f2ab7022bf4814d46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:28.452659 15462 tablet_service.cc:1467] Processing CreateTablet for tablet 0af766830e0b4f02b9d34ecc76d00afd (DEFAULT_TABLE table=test-table [id=e576f23cb15049f2ab7022bf4814d46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:28.453635 15462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af766830e0b4f02b9d34ecc76d00afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:28.453644 15866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af766830e0b4f02b9d34ecc76d00afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:28.456245 15650 tablet_service.cc:1467] Processing CreateTablet for tablet 0af766830e0b4f02b9d34ecc76d00afd (DEFAULT_TABLE table=test-table [id=e576f23cb15049f2ab7022bf4814d46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:28.457274 15650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0af766830e0b4f02b9d34ecc76d00afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:28.459806 15980 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: Bootstrap starting.
I20260809 15:40:28.461197 15981 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Bootstrap starting.
I20260809 15:40:28.462378 15980 tablet_bootstrap.cc:654] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:28.463255 15980 log.cc:824] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:28.463868 15981 tablet_bootstrap.cc:654] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:28.464843 15981 log.cc:824] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:28.465476 15983 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: Bootstrap starting.
I20260809 15:40:28.465548 15980 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: No bootstrap required, opened a new log
I20260809 15:40:28.465726 15980 ts_tablet_manager.cc:1397] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:40:28.467882 15981 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: No bootstrap required, opened a new log
I20260809 15:40:28.468115 15983 tablet_bootstrap.cc:654] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:28.468169 15981 ts_tablet_manager.cc:1397] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:40:28.468940 15983 log.cc:824] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:28.470384 15980 raft_consensus.cc:348] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.470649 15980 raft_consensus.cc:374] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:28.470726 15980 raft_consensus.cc:729] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f60517c1cac74f70aff5ab1c1d21f537, State: Initialized, Role: FOLLOWER
I20260809 15:40:28.470957 15983 tablet_bootstrap.cc:492] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: No bootstrap required, opened a new log
I20260809 15:40:28.471143 15983 ts_tablet_manager.cc:1397] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:40:28.471194 15980 consensus_queue.cc:260] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.471805 15556 heartbeater.cc:503] Master 127.14.15.190:37543 was elected leader, sending a full tablet report...
I20260809 15:40:28.471679 15981 raft_consensus.cc:348] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.471933 15981 raft_consensus.cc:374] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:28.471998 15981 raft_consensus.cc:729] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9659dcf5e82743779146a58081957f7c, State: Initialized, Role: FOLLOWER
I20260809 15:40:28.472173 15980 ts_tablet_manager.cc:1428] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:40:28.472400 15981 consensus_queue.cc:260] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.473065 15951 heartbeater.cc:503] Master 127.14.15.190:37543 was elected leader, sending a full tablet report...
I20260809 15:40:28.473354 15981 ts_tablet_manager.cc:1428] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:40:28.476229 15983 raft_consensus.cc:348] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.476478 15983 raft_consensus.cc:374] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:28.476536 15983 raft_consensus.cc:729] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fc9ec798d3e45db943d269560a031d0, State: Initialized, Role: FOLLOWER
I20260809 15:40:28.476969 15983 consensus_queue.cc:260] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.477622 15753 heartbeater.cc:503] Master 127.14.15.190:37543 was elected leader, sending a full tablet report...
I20260809 15:40:28.477896 15983 ts_tablet_manager.cc:1428] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 15:40:28.521513 15989 raft_consensus.cc:482] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:28.521785 15989 raft_consensus.cc:504] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.523341 15989 leader_election.cc:288] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f60517c1cac74f70aff5ab1c1d21f537 (127.14.15.129:33825), 0fc9ec798d3e45db943d269560a031d0 (127.14.15.130:34511)
I20260809 15:40:28.527134 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.523691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:57159 (local address 127.14.15.129:33825)
0809 15:40:28.523838 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.523843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.523862 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:40:28.523918 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.523924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.523985 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.524086 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:28.524393 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.524995 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526078 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.526549 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526683 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.526739 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.526929 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.526999 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:40:28.527134 15954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.523502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:33825 (local address 127.14.15.131:57159)
0809 15:40:28.523712 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.523730 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.523817 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.524110 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.524113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.524133 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:28.524262 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.524268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.525112 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.525118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.525940 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.525950 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.526676 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.526789 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.526816 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.526912 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.526996 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 15:40:28.527261 15975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.523776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:49303 (local address 127.14.15.130:34511)
0809 15:40:28.523919 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.523925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.524173 (+ 248us) server_negotiation.cc:407] Connection header received
0809 15:40:28.524315 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.524318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.524373 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.524468 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:28.524742 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.525227 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526279 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.526680 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526813 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.526866 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.527064 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.527132 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:40:28.527495 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.523654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34511 (local address 127.14.15.131:49303)
0809 15:40:28.524068 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:28.524079 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:28.524199 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:28.524479 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:28.524481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:28.524498 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:28.524627 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.524632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.525346 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.525350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.526120 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:28.526129 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.526807 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.526811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:28.526923 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.526948 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:40:28.527034 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:40:28.527105 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":132,"threads_started":1}
I20260809 15:40:28.527927 15491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af766830e0b4f02b9d34ecc76d00afd" candidate_uuid: "9659dcf5e82743779146a58081957f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f60517c1cac74f70aff5ab1c1d21f537" is_pre_election: true
I20260809 15:40:28.528121 15686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af766830e0b4f02b9d34ecc76d00afd" candidate_uuid: "9659dcf5e82743779146a58081957f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc9ec798d3e45db943d269560a031d0" is_pre_election: true
I20260809 15:40:28.528379 15491 raft_consensus.cc:2454] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9659dcf5e82743779146a58081957f7c in term 0.
I20260809 15:40:28.528419 15686 raft_consensus.cc:2454] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9659dcf5e82743779146a58081957f7c in term 0.
I20260809 15:40:28.528980 15792 leader_election.cc:302] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fc9ec798d3e45db943d269560a031d0, 9659dcf5e82743779146a58081957f7c; no voters:
I20260809 15:40:28.529242 15989 raft_consensus.cc:2781] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:28.529335 15989 raft_consensus.cc:482] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:28.529368 15989 raft_consensus.cc:3037] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:28.530555 15989 raft_consensus.cc:504] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.531067 15989 leader_election.cc:288] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [CANDIDATE]: Term 1 election: Requested vote from peers f60517c1cac74f70aff5ab1c1d21f537 (127.14.15.129:33825), 0fc9ec798d3e45db943d269560a031d0 (127.14.15.130:34511)
I20260809 15:40:28.531303 15686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af766830e0b4f02b9d34ecc76d00afd" candidate_uuid: "9659dcf5e82743779146a58081957f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc9ec798d3e45db943d269560a031d0"
I20260809 15:40:28.531356 15491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0af766830e0b4f02b9d34ecc76d00afd" candidate_uuid: "9659dcf5e82743779146a58081957f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f60517c1cac74f70aff5ab1c1d21f537"
I20260809 15:40:28.531479 15686 raft_consensus.cc:3037] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:28.531490 15491 raft_consensus.cc:3037] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:28.532692 15686 raft_consensus.cc:2454] T 0af766830e0b4f02b9d34ecc76d00afd P 0fc9ec798d3e45db943d269560a031d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9659dcf5e82743779146a58081957f7c in term 1.
I20260809 15:40:28.532696 15491 raft_consensus.cc:2454] T 0af766830e0b4f02b9d34ecc76d00afd P f60517c1cac74f70aff5ab1c1d21f537 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9659dcf5e82743779146a58081957f7c in term 1.
I20260809 15:40:28.532998 15788 leader_election.cc:302] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9659dcf5e82743779146a58081957f7c, f60517c1cac74f70aff5ab1c1d21f537; no voters:
I20260809 15:40:28.533185 15989 raft_consensus.cc:2781] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:28.533421 15989 raft_consensus.cc:686] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [term 1 LEADER]: Becoming Leader. State: Replica: 9659dcf5e82743779146a58081957f7c, State: Running, Role: LEADER
I20260809 15:40:28.533756 15989 consensus_queue.cc:237] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } }
I20260809 15:40:28.537295 15278 catalog_manager.cc:5495] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9659dcf5e82743779146a58081957f7c (127.14.15.131). New cstate: current_term: 1 leader_uuid: "9659dcf5e82743779146a58081957f7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60517c1cac74f70aff5ab1c1d21f537" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fc9ec798d3e45db943d269560a031d0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9659dcf5e82743779146a58081957f7c" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 44031 } health_report { overall_health: HEALTHY } } }
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:28.553385 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.544011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60130 (local address 127.14.15.129:33825)
0809 15:40:28.544181 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.544186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.544330 (+ 144us) server_negotiation.cc:407] Connection header received
0809 15:40:28.544498 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.544502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.544556 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.544643 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.545357 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.545869 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.546781 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.547010 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.547124 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.549713 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.549726 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.549741 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.549766 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.551531 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.552010 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.552016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.552018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.552103 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.552395 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.552400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.552401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.552676 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.552903 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.553079 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.553206 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:28.583009 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.574069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60146 (local address 127.14.15.129:33825)
0809 15:40:28.574244 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.574249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.574419 (+ 170us) server_negotiation.cc:407] Connection header received
0809 15:40:28.574593 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.574602 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.574647 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.574741 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.575463 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.575996 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.576843 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.577077 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.577185 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.579738 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.579742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.579749 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.579775 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.581179 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.581630 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.581634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.581636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.581726 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.582015 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.582020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.582022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.582199 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.582403 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.582710 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.582842 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:28.610910 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:28.602100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60162 (local address 127.14.15.129:33825)
0809 15:40:28.602302 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:28.602308 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:28.602484 (+ 176us) server_negotiation.cc:407] Connection header received
0809 15:40:28.602669 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:28.602672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:28.602736 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:28.602829 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:28.603566 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.604081 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.604952 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:28.605176 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:28.605299 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:28.607793 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:28.607796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:28.607799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:28.607825 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:28.609083 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.609605 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.609609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.609611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.609698 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:28.609997 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:28.610001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:28.610003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:28.610187 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:28.610357 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:28.610617 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 15:40:28.610744 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 15:40:28.612694 15435 tablet_service.cc:2908] Rejecting scan request for tablet 0af766830e0b4f02b9d34ecc76d00afd: Uninitialized: clean time has not yet been initialized
I20260809 15:40:28.615073 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15372
I20260809 15:40:28.627626 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15562
W20260809 15:40:28.648433 15953 tablet.cc:2369] T 0af766830e0b4f02b9d34ecc76d00afd P 9659dcf5e82743779146a58081957f7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:28.656216 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15760
I20260809 15:40:28.666957 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15243
2026-08-09T15:40:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2579 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[16018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[16018](info): set up 2 sockets
Aug 09 15:40:28 dist-test-slave-jztv krb5kdc[16018](info): commencing operation
krb5kdc: starting...
W20260809 15:40:29.906569 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:29 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:30.041208 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39317
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:30.160915 16042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:30.161247 16042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:30.161330 16042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:30.165462 16042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:30.165560 16042 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:40:30.165591 16042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:30.165630 16042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:30.165663 16042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:30.165694 16042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:30.171156 16042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39317
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:30.172284 16042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:30.173334 16042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:30.182230 16053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.182349 16051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.182528 16042 server_base.cc:1034] running on GCE node
W20260809 15:40:30.182349 16057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.183168 16042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:30.184366 16042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:30.185552 16042 hybrid_clock.cc:648] HybridClock initialized: now 1786290030185512 us; error 52 us; skew 500 ppm
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:30.188537 16042 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:30.189440 16042 webserver.cc:460] Webserver started at http://127.14.15.190:38557/ using document root <none> and password file <none>
I20260809 15:40:30.190016 16042 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:30.190109 16042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:30.190433 16042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:30.192514 16042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "6446304315c04253a417075135a968f7"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "fc184662a88bbc2d6406db6135fe5606"
server_key_iv: "1cce716aa51f3d88702c5452d545797b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.193110 16042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "6446304315c04253a417075135a968f7"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "fc184662a88bbc2d6406db6135fe5606"
server_key_iv: "1cce716aa51f3d88702c5452d545797b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.197103 16042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 15:40:30.199753 16070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.200999 16042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:30.201151 16042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "6446304315c04253a417075135a968f7"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "fc184662a88bbc2d6406db6135fe5606"
server_key_iv: "1cce716aa51f3d88702c5452d545797b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.201278 16042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:30.229710 16042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:30.232924 16042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:30.233160 16042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:30.242515 16042 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39317
I20260809 15:40:30.242527 16168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39317 every 8 connection(s)
I20260809 15:40:30.243546 16042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:30.246500 16169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:30.249022 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 16042
I20260809 15:40:30.249141 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:30.249423 14398 external_mini_cluster.cc:1428] Setting key d6326c4882a196074e2cf14b1fd47c2c
I20260809 15:40:30.253144 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Bootstrap starting.
I20260809 15:40:30.255560 16169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:30.256323 16169 log.cc:824] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:30.258388 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: No bootstrap required, opened a new log
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:30.263362 16169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } }
I20260809 15:40:30.263676 16169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:30.263728 16169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6446304315c04253a417075135a968f7, State: Initialized, Role: FOLLOWER
I20260809 15:40:30.264226 16169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } }
I20260809 15:40:30.264387 16169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:30.264460 16169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:30.264530 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.251007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.14.15.190:39317)
0809 15:40:30.251453 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.251468 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.251521 (+ 53us) server_negotiation.cc:407] Connection header received
0809 15:40:30.252280 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:30.252300 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:30.252660 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:30.253017 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:30.253843 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.254934 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.255843 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.256319 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.256504 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.259187 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:30.259196 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:30.259219 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:30.259258 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:30.261226 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.261696 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.261702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.261708 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.261853 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.262130 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.262133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.262134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.262708 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:30.262918 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:30.263214 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 15:40:30.263535 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":129,"threads_started":1}
I20260809 15:40:30.264564 16169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:30.265888 16169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } }
I20260809 15:40:30.266366 16169 leader_election.cc:302] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6446304315c04253a417075135a968f7; no voters:
I20260809 15:40:30.266746 16169 leader_election.cc:288] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:30.266902 16179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:30.267155 16179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [term 1 LEADER]: Becoming Leader. State: Replica: 6446304315c04253a417075135a968f7, State: Running, Role: LEADER
I20260809 15:40:30.267491 16179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } }
I20260809 15:40:30.268101 16169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:30.268648 16179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6446304315c04253a417075135a968f7. Latest consensus state: current_term: 1 leader_uuid: "6446304315c04253a417075135a968f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } } }
I20260809 15:40:30.268780 16179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:30.269155 16181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6446304315c04253a417075135a968f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6446304315c04253a417075135a968f7" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39317 } } }
I20260809 15:40:30.269265 16181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:30.269388 16184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:30.272933 16184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:30.288695 16184 catalog_manager.cc:1347] Generated new cluster ID: 14fc8b41b7b6415aa170204df3ccd62a
I20260809 15:40:30.288800 16184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:30.305719 16184 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:30.306869 16184 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:30.313266 16184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Generated new TSK 0
I20260809 15:40:30.314136 16184 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:30.345942 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39317
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:30.461184 16206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:30.461486 16206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:30.461570 16206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:30.465687 16206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:30.465793 16206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:30.465870 16206 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:30.465951 16206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:30.471654 16206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:30.472797 16206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:30.473872 16206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:30.484309 16219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.484299 16212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.484356 16213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.484581 16206 server_base.cc:1034] running on GCE node
I20260809 15:40:30.486037 16206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:30.486827 16206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:30.488011 16206 hybrid_clock.cc:648] HybridClock initialized: now 1786290030488003 us; error 32 us; skew 500 ppm
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:30.491362 16206 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:30.492451 16206 webserver.cc:460] Webserver started at http://127.14.15.129:35461/ using document root <none> and password file <none>
I20260809 15:40:30.493103 16206 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:30.493178 16206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:30.493475 16206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:30.496007 16206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "0779b4b629ab4739a5eb616de64a0993"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "5cecdcd6d3ad0c01fdd2a50e030def14"
server_key_iv: "d2e0f1c25d3b790081d4bc539f68ed8c"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.496626 16206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "0779b4b629ab4739a5eb616de64a0993"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "5cecdcd6d3ad0c01fdd2a50e030def14"
server_key_iv: "d2e0f1c25d3b790081d4bc539f68ed8c"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.500981 16206 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 15:40:30.503729 16229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.505366 16206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:40:30.505585 16206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "0779b4b629ab4739a5eb616de64a0993"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "5cecdcd6d3ad0c01fdd2a50e030def14"
server_key_iv: "d2e0f1c25d3b790081d4bc539f68ed8c"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.505702 16206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:30.522636 16206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:30.525987 16206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:30.526312 16206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:30.527901 16206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:30.527990 16206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.528056 16206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:30.528113 16206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:30.539876 16206 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:43735
I20260809 15:40:30.539969 16398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:43735 every 8 connection(s)
I20260809 15:40:30.541138 16206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:30.543088 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.528946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:55771 (local address 127.14.15.190:39317)
0809 15:40:30.529083 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.529087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.530204 (+ 1117us) server_negotiation.cc:407] Connection header received
0809 15:40:30.531504 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:30.531507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:30.531573 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:30.531702 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:30.533546 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.534471 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.535791 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.536045 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.536167 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.538939 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:30.538943 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:30.538946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:30.538978 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:30.540757 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.541342 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.541345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.541346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.541436 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.541870 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.541873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.541875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.542132 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:30.542281 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:30.542804 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 15:40:30.542944 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:40:30.543782 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 16206
I20260809 15:40:30.543918 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:30.543872 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.529524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.129:55771)
0809 15:40:30.530037 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:30.530082 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:30.531192 (+ 1110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:30.531953 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:30.531967 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:30.532507 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:30.533315 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.533340 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.534611 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.534615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.535652 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.535663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.536225 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.536229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.536416 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.537092 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:30.537109 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:30.538741 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:30.540898 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.540904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.540926 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.541211 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.541535 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.541540 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.541542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.541748 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.542274 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:30.542280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:30.542543 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 15:40:30.542714 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 15:40:30.542980 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":134,"threads_started":1}
I20260809 15:40:30.544255 14398 external_mini_cluster.cc:1428] Setting key 76c6f6fcf987262bd7f88f242927c53e
I20260809 15:40:30.545440 16399 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39317
I20260809 15:40:30.545823 16399 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:30.546463 16399 heartbeater.cc:511] Master 127.14.15.190:39317 requested a full tablet report, sending...
I20260809 15:40:30.548187 16096 ts_manager.cc:194] Registered new tserver with Master: 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735)
I20260809 15:40:30.549832 16096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:55771
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:30.556744 16411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.548218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.129:34123)
0809 15:40:30.548567 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:30.548582 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:30.548679 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:30.548950 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:30.548953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:30.549166 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:30.549267 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.549272 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.550365 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.550372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.551435 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.551449 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.552256 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.552261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.552383 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.552909 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:30.552931 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:30.553439 (+ 508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:30.555266 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.555273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.555277 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.555543 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.555836 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.555842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.555846 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.555966 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.556326 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:30.556329 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:30.556409 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 15:40:30.556496 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 15:40:30.556602 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":108,"threads_started":1}
I20260809 15:40:30.556766 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.548304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:34123 (local address 127.14.15.190:39317)
0809 15:40:30.548438 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.548444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.548660 (+ 216us) server_negotiation.cc:407] Connection header received
0809 15:40:30.548757 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:30.548762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:30.548814 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:30.548907 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:30.549391 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.550190 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.551590 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.551980 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.552072 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.553588 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:30.553591 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:30.553593 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:30.553615 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:30.555141 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.555652 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.555655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.555656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.555733 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.556057 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.556060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.556061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.556224 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:30.556302 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:30.556565 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:40:30.556656 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":47}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:30.577829 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39317
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:30.694566 16415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:30.694875 16415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:30.694957 16415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:30.699546 16415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:30.699651 16415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:30.699719 16415 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:30.699806 16415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:30.707185 16415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:30.708340 16415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:30.709456 16415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:30.719589 16420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.719590 16425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.719561 16421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.719866 16415 server_base.cc:1034] running on GCE node
I20260809 15:40:30.720340 16415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:30.721019 16415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:30.722285 16415 hybrid_clock.cc:648] HybridClock initialized: now 1786290030722206 us; error 33 us; skew 500 ppm
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:30.725091 16415 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:30.726019 16415 webserver.cc:460] Webserver started at http://127.14.15.130:34613/ using document root <none> and password file <none>
I20260809 15:40:30.726629 16415 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:30.726692 16415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:30.726867 16415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:30.728936 16415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "3723bc17abc6492ca113d5d5d8d27dc2"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "517106a3a5e6302324efb3f3ce6662d4"
server_key_iv: "b942049f767d944a683a939a05040e5b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.729492 16415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "3723bc17abc6492ca113d5d5d8d27dc2"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "517106a3a5e6302324efb3f3ce6662d4"
server_key_iv: "b942049f767d944a683a939a05040e5b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.733482 16415 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:30.736271 16432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.737584 16415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:30.737739 16415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "3723bc17abc6492ca113d5d5d8d27dc2"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "517106a3a5e6302324efb3f3ce6662d4"
server_key_iv: "b942049f767d944a683a939a05040e5b"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.737856 16415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:30.757889 16415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:30.760972 16415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:30.761195 16415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:30.762849 16415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:30.762902 16415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.762943 16415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:30.762998 16415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:30.774870 16415 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:34161
I20260809 15:40:30.775050 16612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:34161 every 8 connection(s)
I20260809 15:40:30.776158 16415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:30.779791 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.763913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:54507 (local address 127.14.15.190:39317)
0809 15:40:30.764114 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.764120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.765184 (+ 1064us) server_negotiation.cc:407] Connection header received
0809 15:40:30.766562 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:30.766566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:30.766625 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:30.766724 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:30.768427 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.769411 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.771838 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.772064 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.772154 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.775560 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:30.775564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:30.775566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:30.775592 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:30.777380 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.778029 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.778033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.778035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.778139 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.778644 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.778647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.778648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.778864 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:30.779023 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:30.779551 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 15:40:30.779671 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 15:40:30.780639 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.764544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.130:54507)
0809 15:40:30.765035 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:30.765086 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:30.766329 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:30.766878 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:30.766884 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:30.767395 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:30.768160 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.768180 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.769629 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.769633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.771667 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.771678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.772243 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.772249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.772479 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.773242 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:30.773271 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:30.775363 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:30.777517 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.777524 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.777539 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.777873 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.778310 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.778314 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.778316 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.778505 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.779022 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:30.779028 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:30.779272 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 15:40:30.779454 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 15:40:30.779739 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":140,"threads_started":1}
I20260809 15:40:30.782006 16613 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39317
I20260809 15:40:30.782176 16613 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:30.782774 16613 heartbeater.cc:511] Master 127.14.15.190:39317 requested a full tablet report, sending...
I20260809 15:40:30.783878 16096 ts_manager.cc:194] Registered new tserver with Master: 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161)
I20260809 15:40:30.784677 16096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:54507
I20260809 15:40:30.785187 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 16415
I20260809 15:40:30.785316 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:30.785600 14398 external_mini_cluster.cc:1428] Setting key 7b5b2c898fcc1a090ec599d9e44c48fe
I20260809 15:40:30.793293 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.784352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:41591 (local address 127.14.15.190:39317)
0809 15:40:30.784489 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.784493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.784721 (+ 228us) server_negotiation.cc:407] Connection header received
0809 15:40:30.784819 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:30.784822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:30.784921 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:30.785044 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:30.785802 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.786604 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.787574 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.787809 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.787925 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.789264 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:30.789268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:30.789270 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:30.789293 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:30.790908 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.791651 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.791654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.791655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.791746 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:30.792165 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:30.792168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:30.792169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:30.792539 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:30.792640 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:30.793051 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 15:40:30.793164 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:40:30.793437 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.784279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.130:41591)
0809 15:40:30.784607 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:30.784623 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:30.784733 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:30.785188 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:30.785191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:30.785457 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:30.785665 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.785673 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.786767 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.786770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.787451 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:30.787460 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:30.787931 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:30.787935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:30.788025 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:30.788628 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:30.788640 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:30.789117 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:30.791030 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.791037 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.791042 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.791326 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.791857 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:30.791863 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:30.791868 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:30.792002 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:30.792686 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:30.792690 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:30.792836 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 15:40:30.792984 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 15:40:30.793190 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":18,"thread_start_us":130,"threads_started":1}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:30.817984 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39317
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:30.936187 16627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:30.936456 16627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:30.936502 16627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:30.940613 16627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:30.940675 16627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:30.940742 16627 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:30.940806 16627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:30.946205 16627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:30.947336 16627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:30.948390 16627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:30.958128 16636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.958186 16627 server_base.cc:1034] running on GCE node
W20260809 15:40:30.958262 16638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:30.958140 16635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:30.958803 16627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:30.959508 16627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:30.960703 16627 hybrid_clock.cc:648] HybridClock initialized: now 1786290030960688 us; error 26 us; skew 500 ppm
Aug 09 15:40:30 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:30.963450 16627 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:30.964313 16627 webserver.cc:460] Webserver started at http://127.14.15.131:45861/ using document root <none> and password file <none>
I20260809 15:40:30.964880 16627 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:30.964975 16627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:30.965226 16627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:30.967296 16627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "24ac43205045429f96f78733fecf8bbd"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "b4ff53a383f73c32d239f0ca480e9206"
server_key_iv: "0ffd619e9758c9de916c3ce270384a5d"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.967875 16627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "24ac43205045429f96f78733fecf8bbd"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "b4ff53a383f73c32d239f0ca480e9206"
server_key_iv: "0ffd619e9758c9de916c3ce270384a5d"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.971868 16627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:30.974179 16654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.975420 16627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:30.975558 16627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "24ac43205045429f96f78733fecf8bbd"
format_stamp: "Formatted at 2026-08-09 15:40:30 on dist-test-slave-jztv"
server_key: "b4ff53a383f73c32d239f0ca480e9206"
server_key_iv: "0ffd619e9758c9de916c3ce270384a5d"
server_key_version: "encryptionkey@0"
I20260809 15:40:30.975682 16627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:30.993194 16627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:30.996141 16627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:30.996346 16627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:30.997740 16627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:30.997819 16627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:30.997890 16627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:30.997925 16627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:31.009724 16627 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:43537
I20260809 15:40:31.009799 16837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:43537 every 8 connection(s)
I20260809 15:40:31.010937 16627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:31.012851 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.998655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:52293 (local address 127.14.15.190:39317)
0809 15:40:30.998840 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:30.998847 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:30.999705 (+ 858us) server_negotiation.cc:407] Connection header received
0809 15:40:31.001001 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.001006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.001078 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.001146 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.003044 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.003719 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.005177 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.005556 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.005657 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.008884 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.008888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.008891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.008920 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.010752 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.011328 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.011332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.011334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.011437 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.011883 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.011887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.011892 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.012109 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.012190 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.012620 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.012728 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:40:31.013666 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:30.999001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.131:52293)
0809 15:40:30.999519 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:30.999579 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.000725 (+ 1146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.001616 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.001628 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.002096 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:31.002860 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.002886 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.003874 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.003878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.005047 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.005057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.005740 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.005745 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.005978 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.006702 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:31.006722 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:31.008692 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:31.010870 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.010875 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.010886 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.011217 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.011567 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.011573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.011576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.011770 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.012184 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:31.012189 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:31.012402 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.012564 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.012802 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":108,"threads_started":1}
I20260809 15:40:31.014974 16839 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39317
I20260809 15:40:31.015139 16839 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:31.015609 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 16627
I20260809 15:40:31.015692 16839 heartbeater.cc:511] Master 127.14.15.190:39317 requested a full tablet report, sending...
I20260809 15:40:31.015738 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:31.016062 14398 external_mini_cluster.cc:1428] Setting key 9ed57989a9dd1618f813dae06224b82c
I20260809 15:40:31.017407 16097 ts_manager.cc:194] Registered new tserver with Master: 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537)
I20260809 15:40:31.018327 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:40:31.018317 16097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:52293
I20260809 15:40:31.025848 16846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.017438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.14.15.131:39931)
0809 15:40:31.017782 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.017798 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.017925 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.018312 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.018315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.018529 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:31.018650 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.018657 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.019668 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.019675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.020651 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.020667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.021308 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.021311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.021384 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.021931 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:31.021951 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:31.022462 (+ 511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:31.024196 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.024203 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.024208 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.024482 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.024798 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.024801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.024803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.024905 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.025405 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:31.025407 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:31.025491 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.025586 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.025698 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":105,"threads_started":1}
I20260809 15:40:31.026077 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.017447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39931 (local address 127.14.15.190:39317)
0809 15:40:31.017617 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.017621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.017884 (+ 263us) server_negotiation.cc:407] Connection header received
0809 15:40:31.018010 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.018013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.018062 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.018139 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.018752 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.019511 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.020801 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.021183 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.021308 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.022610 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.022613 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.022615 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.022637 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.024078 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.024600 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.024603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.024604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.024681 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.025039 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.025042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.025044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.025291 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.025406 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.025684 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.025826 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290031, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290031, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:31.047592 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.039180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.14.15.190:39317)
0809 15:40:31.039311 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.039315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.039326 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:40:31.039380 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.039383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.039420 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.039519 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.040243 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.040761 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.041668 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.041886 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.042010 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.044582 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.044585 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.044587 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.044621 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.046047 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.046492 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.046494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.046495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.046575 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.046887 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.046889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.046890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.047077 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.047181 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.047370 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.047465 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:40:31.050647 16097 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:31.053660 16097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:31.067859 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.062429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.14.15.130:34161)
0809 15:40:31.063439 (+ 1010us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.063452 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.063479 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:40:31.063578 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.063583 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.063791 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.063954 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.064321 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065116 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.066553 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.067121 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.067253 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.067427 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.067610 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.067706 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":117,"threads_started":1}
I20260809 15:40:31.067845 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.062280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34161 (local address 127.0.0.1:34814)
0809 15:40:31.062753 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.062803 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.062935 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.063963 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.063968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.063992 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.064157 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.064164 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065241 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.065246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.066415 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.066426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.067253 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.067257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.067379 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.067424 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.067568 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.067698 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":72,"threads_started":1}
I20260809 15:40:31.068747 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.062854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43537 (local address 127.0.0.1:34616)
0809 15:40:31.063304 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.063317 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.063418 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.064119 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.064122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.064144 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.064263 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.064270 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065784 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.065788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.067113 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.067124 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.068227 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.068233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.068365 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.068390 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.068470 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.068620 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":85,"thread_start_us":99,"threads_started":1}
I20260809 15:40:31.068861 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.062509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34616 (local address 127.14.15.131:43537)
0809 15:40:31.063239 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.063252 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.063523 (+ 271us) server_negotiation.cc:407] Connection header received
0809 15:40:31.063615 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.063621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.063828 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.063981 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.064413 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065637 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.067257 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.068062 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.068195 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.068397 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.068629 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.068717 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":111,"threads_started":1}
I20260809 15:40:31.069726 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.063162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.14.15.129:43735)
0809 15:40:31.063539 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.063548 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.063770 (+ 222us) server_negotiation.cc:407] Connection header received
0809 15:40:31.063912 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.063917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.064098 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.064240 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.064494 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065636 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.067398 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.068122 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.068210 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.068332 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.068809 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.068908 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":85,"threads_started":1}
I20260809 15:40:31.070037 16865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.062999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:43735 (local address 127.0.0.1:51244)
0809 15:40:31.063672 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.063684 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.063780 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.064238 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.064244 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.064266 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.064373 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.064380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.065784 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.065788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.067277 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.067286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.068399 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.068403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.068513 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.068539 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.068612 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.068686 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"mutex_wait_us":41,"thread_start_us":96,"threads_started":1}
I20260809 15:40:31.071620 16511 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 (DEFAULT_TABLE table=test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.071677 16736 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 (DEFAULT_TABLE table=test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.072594 16511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4be0199be74ebdb092ad0eec5c03a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.072705 16736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4be0199be74ebdb092ad0eec5c03a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.072502 16304 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 (DEFAULT_TABLE table=test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.073395 16304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4be0199be74ebdb092ad0eec5c03a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.079455 16868 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Bootstrap starting.
I20260809 15:40:31.080840 16873 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Bootstrap starting.
I20260809 15:40:31.081833 16868 tablet_bootstrap.cc:654] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.082512 16870 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Bootstrap starting.
I20260809 15:40:31.082787 16873 tablet_bootstrap.cc:654] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.082770 16868 log.cc:824] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:31.083690 16873 log.cc:824] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:31.084602 16870 tablet_bootstrap.cc:654] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.084829 16868 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: No bootstrap required, opened a new log
I20260809 15:40:31.085040 16868 ts_tablet_manager.cc:1397] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:40:31.085382 16870 log.cc:824] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:31.085690 16873 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: No bootstrap required, opened a new log
I20260809 15:40:31.085911 16873 ts_tablet_manager.cc:1397] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:40:31.087291 16870 tablet_bootstrap.cc:492] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: No bootstrap required, opened a new log
I20260809 15:40:31.087460 16870 ts_tablet_manager.cc:1397] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:40:31.088465 16868 raft_consensus.cc:348] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.088855 16868 raft_consensus.cc:374] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.088979 16868 raft_consensus.cc:729] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3723bc17abc6492ca113d5d5d8d27dc2, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.089473 16868 consensus_queue.cc:260] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.090171 16613 heartbeater.cc:503] Master 127.14.15.190:39317 was elected leader, sending a full tablet report...
I20260809 15:40:31.090541 16868 ts_tablet_manager.cc:1428] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent starting tablet: real 0.005s user 0.002s sys 0.005s
I20260809 15:40:31.089881 16873 raft_consensus.cc:348] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.091362 16873 raft_consensus.cc:374] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.091467 16873 raft_consensus.cc:729] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ac43205045429f96f78733fecf8bbd, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.091900 16873 consensus_queue.cc:260] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.091831 16870 raft_consensus.cc:348] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.092080 16870 raft_consensus.cc:374] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.092154 16870 raft_consensus.cc:729] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0779b4b629ab4739a5eb616de64a0993, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.092578 16839 heartbeater.cc:503] Master 127.14.15.190:39317 was elected leader, sending a full tablet report...
I20260809 15:40:31.092883 16873 ts_tablet_manager.cc:1428] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 15:40:31.093801 16870 consensus_queue.cc:260] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.094462 16399 heartbeater.cc:503] Master 127.14.15.190:39317 was elected leader, sending a full tablet report...
I20260809 15:40:31.094779 16870 ts_tablet_manager.cc:1428] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 15:40:31.141034 16879 raft_consensus.cc:482] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:31.141314 16879 raft_consensus.cc:504] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.142733 16879 leader_election.cc:288] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161), 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735)
I20260809 15:40:31.147171 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.143026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34161 (local address 127.14.15.131:43043)
0809 15:40:31.143165 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.143183 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.143282 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.143679 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.143682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.143703 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.143832 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.143866 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.144812 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.144815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.145787 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.145845 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.146805 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.146808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.146915 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.146937 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.147009 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.147064 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 15:40:31.147253 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.143108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:43043 (local address 127.14.15.130:34161)
0809 15:40:31.143256 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.143264 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.143281 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:40:31.143421 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.143424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.143472 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.143540 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.144004 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.144696 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.145984 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.146674 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.146802 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.146854 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.147053 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.147119 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:40:31.147913 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4be0199be74ebdb092ad0eec5c03a0" candidate_uuid: "24ac43205045429f96f78733fecf8bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" is_pre_election: true
I20260809 15:40:31.148243 16529 raft_consensus.cc:2454] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24ac43205045429f96f78733fecf8bbd in term 0.
I20260809 15:40:31.148590 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.143541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:33791 (local address 127.14.15.129:43735)
0809 15:40:31.143691 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.143696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.143897 (+ 201us) server_negotiation.cc:407] Connection header received
0809 15:40:31.144056 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.144058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.144101 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.144160 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.144476 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.145109 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.147374 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.147924 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.148002 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.148038 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.148406 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.148483 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 15:40:31.148603 16881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.143326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:43735 (local address 127.14.15.131:33791)
0809 15:40:31.143768 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.143785 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.143905 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.144199 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.144202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.144223 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.144354 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.144361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.145249 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.145252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.147220 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.147230 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.148178 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.148185 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.148276 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.148292 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.148385 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.148463 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":158,"threads_started":1}
I20260809 15:40:31.148792 16655 leader_election.cc:302] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24ac43205045429f96f78733fecf8bbd, 3723bc17abc6492ca113d5d5d8d27dc2; no voters:
I20260809 15:40:31.149137 16879 raft_consensus.cc:2781] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:31.149245 16879 raft_consensus.cc:482] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:31.149303 16879 raft_consensus.cc:3037] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.149734 16331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4be0199be74ebdb092ad0eec5c03a0" candidate_uuid: "24ac43205045429f96f78733fecf8bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0779b4b629ab4739a5eb616de64a0993" is_pre_election: true
I20260809 15:40:31.150025 16331 raft_consensus.cc:2454] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24ac43205045429f96f78733fecf8bbd in term 0.
I20260809 15:40:31.150810 16879 raft_consensus.cc:504] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.151153 16879 leader_election.cc:288] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [CANDIDATE]: Term 1 election: Requested vote from peers 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161), 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735)
I20260809 15:40:31.151515 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4be0199be74ebdb092ad0eec5c03a0" candidate_uuid: "24ac43205045429f96f78733fecf8bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3723bc17abc6492ca113d5d5d8d27dc2"
I20260809 15:40:31.151577 16331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4be0199be74ebdb092ad0eec5c03a0" candidate_uuid: "24ac43205045429f96f78733fecf8bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0779b4b629ab4739a5eb616de64a0993"
I20260809 15:40:31.151629 16529 raft_consensus.cc:3037] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.151743 16331 raft_consensus.cc:3037] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.152853 16331 raft_consensus.cc:2454] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24ac43205045429f96f78733fecf8bbd in term 1.
I20260809 15:40:31.153208 16655 leader_election.cc:302] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0779b4b629ab4739a5eb616de64a0993, 24ac43205045429f96f78733fecf8bbd; no voters:
I20260809 15:40:31.153242 16529 raft_consensus.cc:2454] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24ac43205045429f96f78733fecf8bbd in term 1.
I20260809 15:40:31.153414 16879 raft_consensus.cc:2781] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:31.153681 16879 raft_consensus.cc:686] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 1 LEADER]: Becoming Leader. State: Replica: 24ac43205045429f96f78733fecf8bbd, State: Running, Role: LEADER
I20260809 15:40:31.154062 16879 consensus_queue.cc:237] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } }
I20260809 15:40:31.157703 16097 catalog_manager.cc:5495] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 24ac43205045429f96f78733fecf8bbd (127.14.15.131). New cstate: current_term: 1 leader_uuid: "24ac43205045429f96f78733fecf8bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } health_report { overall_health: UNKNOWN } } }
I20260809 15:40:31.177371 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.173686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34624 (local address 127.14.15.131:43537)
0809 15:40:31.173817 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.173820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.173834 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:40:31.173960 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.173962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.174018 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.174105 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:31.174410 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.174923 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.175839 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.176065 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.176150 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.176521 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.176993 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.177084 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.177199 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.177254 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:40:31.184315 16529 raft_consensus.cc:1261] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Refusing update from remote peer 24ac43205045429f96f78733fecf8bbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:31.185120 16879 consensus_queue.cc:1035] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.186182 16331 raft_consensus.cc:1261] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Refusing update from remote peer 24ac43205045429f96f78733fecf8bbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:31.186869 16879 consensus_queue.cc:1035] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.192590 16886 mvcc.cc:205] Tried to move back new op lower bound from 7316643967721385984 to 7316643967610605568. Current Snapshot: MvccSnapshot[applied={T|T < 7316643967721385984}]
I20260809 15:40:31.192844 16887 mvcc.cc:205] Tried to move back new op lower bound from 7316643967721385984 to 7316643967610605568. Current Snapshot: MvccSnapshot[applied={T|T < 7316643967721385984}]
I20260809 15:40:31.196746 16889 mvcc.cc:205] Tried to move back new op lower bound from 7316643967721385984 to 7316643967610605568. Current Snapshot: MvccSnapshot[applied={T|T < 7316643967721385984}]
I20260809 15:40:31.207442 16094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:31.207682 16094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:31.210706 16094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Sending DeleteTablet for 3 replicas of tablet 2c4be0199be74ebdb092ad0eec5c03a0
I20260809 15:40:31.211632 16736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:34616
I20260809 15:40:31.211715 16511 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:34814
I20260809 15:40:31.211798 16304 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4be0199be74ebdb092ad0eec5c03a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:51244
I20260809 15:40:31.212234 16903 tablet_replica.cc:330] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: stopping tablet replica
I20260809 15:40:31.212431 16904 tablet_replica.cc:330] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: stopping tablet replica
I20260809 15:40:31.212598 16903 raft_consensus.cc:2229] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:31.212882 16904 raft_consensus.cc:2229] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:31.212937 16903 raft_consensus.cc:2258] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.213279 16904 raft_consensus.cc:2258] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.213321 16094 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:31.213770 16094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:31.214699 16901 tablet_replica.cc:330] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: stopping tablet replica
I20260809 15:40:31.214974 16901 raft_consensus.cc:2229] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:31.215240 16904 ts_tablet_manager.cc:1905] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.215468 16901 raft_consensus.cc:2258] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.216823 16901 ts_tablet_manager.cc:1905] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.218541 16904 ts_tablet_manager.cc:1918] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:31.218703 16904 log.cc:1196] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/2c4be0199be74ebdb092ad0eec5c03a0
I20260809 15:40:31.219123 16904 ts_tablet_manager.cc:1939] T 2c4be0199be74ebdb092ad0eec5c03a0 P 0779b4b629ab4739a5eb616de64a0993: Deleting consensus metadata
I20260809 15:40:31.219724 16901 ts_tablet_manager.cc:1918] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:31.219827 16901 log.cc:1196] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/2c4be0199be74ebdb092ad0eec5c03a0
I20260809 15:40:31.220167 16901 ts_tablet_manager.cc:1939] T 2c4be0199be74ebdb092ad0eec5c03a0 P 24ac43205045429f96f78733fecf8bbd: Deleting consensus metadata
I20260809 15:40:31.220834 16071 catalog_manager.cc:4841] TS 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735): tablet 2c4be0199be74ebdb092ad0eec5c03a0 (table test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]) successfully deleted
I20260809 15:40:31.220881 16304 tablet_service.cc:1467] Processing CreateTablet for tablet caf59488bda042e8871be69ed85fc3e1 (DEFAULT_TABLE table=test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.220985 16511 tablet_service.cc:1467] Processing CreateTablet for tablet caf59488bda042e8871be69ed85fc3e1 (DEFAULT_TABLE table=test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.221129 16304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf59488bda042e8871be69ed85fc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.221254 16511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf59488bda042e8871be69ed85fc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.222575 16075 catalog_manager.cc:4841] TS 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537): tablet 2c4be0199be74ebdb092ad0eec5c03a0 (table test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]) successfully deleted
I20260809 15:40:31.223084 16903 ts_tablet_manager.cc:1905] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.223524 16736 tablet_service.cc:1467] Processing CreateTablet for tablet caf59488bda042e8871be69ed85fc3e1 (DEFAULT_TABLE table=test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:31.223680 16868 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Bootstrap starting.
I20260809 15:40:31.223783 16736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf59488bda042e8871be69ed85fc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.224632 16868 tablet_bootstrap.cc:654] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.225576 16903 ts_tablet_manager.cc:1918] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:31.225663 16903 log.cc:1196] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/2c4be0199be74ebdb092ad0eec5c03a0
I20260809 15:40:31.225984 16903 ts_tablet_manager.cc:1939] T 2c4be0199be74ebdb092ad0eec5c03a0 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting consensus metadata
I20260809 15:40:31.226239 16873 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Bootstrap starting.
I20260809 15:40:31.226342 16870 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Bootstrap starting.
I20260809 15:40:31.226713 16868 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: No bootstrap required, opened a new log
I20260809 15:40:31.226786 16868 ts_tablet_manager.cc:1397] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:31.227190 16873 tablet_bootstrap.cc:654] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.227250 16870 tablet_bootstrap.cc:654] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.227209 16868 raft_consensus.cc:348] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.227320 16868 raft_consensus.cc:374] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.227355 16868 raft_consensus.cc:729] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3723bc17abc6492ca113d5d5d8d27dc2, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.227476 16868 consensus_queue.cc:260] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.227730 16868 ts_tablet_manager.cc:1428] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:31.229095 16870 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: No bootstrap required, opened a new log
I20260809 15:40:31.229136 16071 catalog_manager.cc:4841] TS 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161): tablet 2c4be0199be74ebdb092ad0eec5c03a0 (table test-table [id=d1aa3f0088284e77b5e016c6f5f1375f]) successfully deleted
I20260809 15:40:31.229187 16870 ts_tablet_manager.cc:1397] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:31.230026 16870 raft_consensus.cc:348] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.230154 16870 raft_consensus.cc:374] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.230189 16870 raft_consensus.cc:729] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0779b4b629ab4739a5eb616de64a0993, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.230371 16873 tablet_bootstrap.cc:492] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: No bootstrap required, opened a new log
I20260809 15:40:31.230340 16870 consensus_queue.cc:260] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.230458 16873 ts_tablet_manager.cc:1397] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 15:40:31.230634 16870 ts_tablet_manager.cc:1428] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:31.230919 16873 raft_consensus.cc:348] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.231007 16873 raft_consensus.cc:374] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.231029 16873 raft_consensus.cc:729] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ac43205045429f96f78733fecf8bbd, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.231199 16873 consensus_queue.cc:260] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.231488 16873 ts_tablet_manager.cc:1428] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20260809 15:40:31.261969 16840 tablet.cc:2369] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:31.274622 16878 raft_consensus.cc:482] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:31.274788 16878 raft_consensus.cc:504] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.275921 16878 leader_election.cc:288] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735), 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537)
W20260809 15:40:31.277352 16614 tablet.cc:2369] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:31.280588 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.276098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:43735 (local address 127.14.15.130:43453)
0809 15:40:31.276290 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.276308 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.276402 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.276772 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.276775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.276798 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.276926 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.276933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.278052 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.278055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.279226 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.279237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.280120 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.280124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.280241 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.280269 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.280350 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.280433 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 15:40:31.280613 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.276262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:43453 (local address 127.14.15.129:43735)
0809 15:40:31.276487 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.276493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.276507 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:40:31.276560 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.276564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.276615 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.276695 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.277081 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.277916 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.279388 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.279989 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.280137 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.280197 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.280375 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.280465 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260809 15:40:31.281217 16911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.276185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43537 (local address 127.14.15.130:51067)
0809 15:40:31.276609 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.276622 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.276707 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.277015 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.277018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.277034 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.277201 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.277210 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.278177 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.278181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.279595 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.279607 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.280588 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.280591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.280855 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.280892 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.280974 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.281055 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260809 15:40:31.281219 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.276547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51067 (local address 127.14.15.131:43537)
0809 15:40:31.276675 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.276680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.276695 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:40:31.276857 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.276865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.276909 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.277009 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.277343 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.278044 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.279737 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.280341 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.280455 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.280502 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.280996 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.281081 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:40:31.281213 16331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf59488bda042e8871be69ed85fc3e1" candidate_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0779b4b629ab4739a5eb616de64a0993" is_pre_election: true
I20260809 15:40:31.281392 16331 raft_consensus.cc:2454] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3723bc17abc6492ca113d5d5d8d27dc2 in term 0.
I20260809 15:40:31.281819 16433 leader_election.cc:302] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0779b4b629ab4739a5eb616de64a0993, 3723bc17abc6492ca113d5d5d8d27dc2; no voters:
I20260809 15:40:31.282138 16878 raft_consensus.cc:2781] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:31.282187 16878 raft_consensus.cc:482] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:31.282223 16878 raft_consensus.cc:3037] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.282097 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf59488bda042e8871be69ed85fc3e1" candidate_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ac43205045429f96f78733fecf8bbd" is_pre_election: true
I20260809 15:40:31.282454 16768 raft_consensus.cc:2454] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3723bc17abc6492ca113d5d5d8d27dc2 in term 0.
I20260809 15:40:31.283569 16878 raft_consensus.cc:504] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.284000 16878 leader_election.cc:288] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [CANDIDATE]: Term 1 election: Requested vote from peers 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735), 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537)
I20260809 15:40:31.284368 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf59488bda042e8871be69ed85fc3e1" candidate_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ac43205045429f96f78733fecf8bbd"
I20260809 15:40:31.284386 16331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf59488bda042e8871be69ed85fc3e1" candidate_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0779b4b629ab4739a5eb616de64a0993"
I20260809 15:40:31.284521 16768 raft_consensus.cc:3037] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.284528 16331 raft_consensus.cc:3037] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.285589 16768 raft_consensus.cc:2454] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3723bc17abc6492ca113d5d5d8d27dc2 in term 1.
I20260809 15:40:31.285730 16331 raft_consensus.cc:2454] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3723bc17abc6492ca113d5d5d8d27dc2 in term 1.
I20260809 15:40:31.285975 16441 leader_election.cc:302] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24ac43205045429f96f78733fecf8bbd, 3723bc17abc6492ca113d5d5d8d27dc2; no voters:
I20260809 15:40:31.286314 16878 raft_consensus.cc:2781] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:31.286513 16878 raft_consensus.cc:686] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3723bc17abc6492ca113d5d5d8d27dc2, State: Running, Role: LEADER
I20260809 15:40:31.287014 16878 consensus_queue.cc:237] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.289567 16096 catalog_manager.cc:5495] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } health_report { overall_health: UNKNOWN } } }
W20260809 15:40:31.292800 16401 tablet.cc:2369] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290030, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:31.333935 16927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.324133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39317 (local address 127.0.0.1:45618)
0809 15:40:31.324442 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.324459 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.324582 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.324878 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.324881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.325265 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:31.325364 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.325370 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.326474 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.326477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.327108 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.327117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.327738 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.327741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.327838 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.328531 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:31.328544 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:31.330034 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:31.332123 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.332132 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.332136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.332390 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.332776 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:31.332778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:31.332780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:31.332880 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:31.333401 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:31.333408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:31.333538 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.333653 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.333788 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":18,"thread_start_us":114,"threads_started":1}
I20260809 15:40:31.334241 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.324240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45618 (local address 127.14.15.190:39317)
0809 15:40:31.324388 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.324393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.324554 (+ 161us) server_negotiation.cc:407] Connection header received
0809 15:40:31.324676 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.324679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.324733 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.324840 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.325529 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.326334 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.327237 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.327608 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.327719 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.330195 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.330199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.330201 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.330253 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.331988 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.332539 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.332542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.332544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.332646 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.332986 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.332990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.332992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.333247 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.333367 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.333756 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.333893 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":62}
I20260809 15:40:31.338599 16096 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:45618:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:40:31.339453 16096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:31.344983 16511 tablet_service.cc:1467] Processing CreateTablet for tablet f216e868e66e404c8562ea7831d9f496 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c67d39850e6748328ccc58a1620d2fcc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:31.345470 16511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f216e868e66e404c8562ea7831d9f496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.346696 16736 tablet_service.cc:1467] Processing CreateTablet for tablet f216e868e66e404c8562ea7831d9f496 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c67d39850e6748328ccc58a1620d2fcc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:31.347092 16736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f216e868e66e404c8562ea7831d9f496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.344983 16304 tablet_service.cc:1467] Processing CreateTablet for tablet f216e868e66e404c8562ea7831d9f496 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c67d39850e6748328ccc58a1620d2fcc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:31.347515 16304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f216e868e66e404c8562ea7831d9f496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:31.348394 16868 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: Bootstrap starting.
I20260809 15:40:31.349421 16868 tablet_bootstrap.cc:654] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.350127 16873 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: Bootstrap starting.
I20260809 15:40:31.350600 16870 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: Bootstrap starting.
I20260809 15:40:31.351567 16873 tablet_bootstrap.cc:654] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.351588 16870 tablet_bootstrap.cc:654] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:31.352980 16873 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: No bootstrap required, opened a new log
I20260809 15:40:31.353080 16873 ts_tablet_manager.cc:1397] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 15:40:31.353281 16868 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: No bootstrap required, opened a new log
I20260809 15:40:31.353371 16868 ts_tablet_manager.cc:1397] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 15:40:31.353565 16873 raft_consensus.cc:348] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.353699 16873 raft_consensus.cc:374] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.353735 16873 raft_consensus.cc:729] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ac43205045429f96f78733fecf8bbd, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.353823 16868 raft_consensus.cc:348] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.353899 16873 consensus_queue.cc:260] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.353972 16868 raft_consensus.cc:374] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.354017 16868 raft_consensus.cc:729] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3723bc17abc6492ca113d5d5d8d27dc2, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.354163 16896 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.354162 16868 consensus_queue.cc:260] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.354334 16896 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.354521 16868 ts_tablet_manager.cc:1428] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:40:31.354554 16878 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.354686 16878 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.356195 16870 tablet_bootstrap.cc:492] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: No bootstrap required, opened a new log
I20260809 15:40:31.356297 16870 ts_tablet_manager.cc:1397] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 15:40:31.356815 16870 raft_consensus.cc:348] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.356941 16870 raft_consensus.cc:374] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:31.357004 16870 raft_consensus.cc:729] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0779b4b629ab4739a5eb616de64a0993, State: Initialized, Role: FOLLOWER
I20260809 15:40:31.357173 16873 ts_tablet_manager.cc:1428] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260809 15:40:31.357184 16870 consensus_queue.cc:260] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.357520 16870 ts_tablet_manager.cc:1428] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:40:31.357466 16880 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.357615 16880 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.663275 16880 raft_consensus.cc:482] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:31.663452 16880 raft_consensus.cc:504] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.664685 16880 leader_election.cc:288] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161), 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537)
I20260809 15:40:31.669572 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.665108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:48155 (local address 127.14.15.131:43537)
0809 15:40:31.665255 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.665261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.665544 (+ 283us) server_negotiation.cc:407] Connection header received
0809 15:40:31.665628 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.665632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.665694 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.665784 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.666174 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.666814 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.668231 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.668650 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.668798 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.668908 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.669390 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.669461 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:40:31.669662 16932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.664984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34161 (local address 127.14.15.129:41403)
0809 15:40:31.665660 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.665675 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.665792 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.666140 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.666142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.666166 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.666289 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.666312 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.667212 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.667215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.668119 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.668130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.668998 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.669002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.669204 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.669273 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.669357 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.669472 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":106,"thread_start_us":137,"threads_started":1}
I20260809 15:40:31.669662 16934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.664970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43537 (local address 127.14.15.129:48155)
0809 15:40:31.665376 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.665394 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.665537 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.665865 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.665869 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.665894 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:31.666037 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.666047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.666944 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.666948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.668098 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.668108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.668998 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.669002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.669230 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.669282 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.669357 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.669478 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":153,"thread_start_us":121,"threads_started":1}
I20260809 15:40:31.670115 16937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.665133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41403 (local address 127.14.15.130:34161)
0809 15:40:31.665377 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.665383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.665856 (+ 473us) server_negotiation.cc:407] Connection header received
0809 15:40:31.665937 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.665940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.665989 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.666096 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:31.666458 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.667071 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.668277 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.668877 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.668985 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.669068 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.669860 (+ 792us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.669935 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
I20260809 15:40:31.670449 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f216e868e66e404c8562ea7831d9f496" candidate_uuid: "0779b4b629ab4739a5eb616de64a0993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ac43205045429f96f78733fecf8bbd" is_pre_election: true
I20260809 15:40:31.670552 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f216e868e66e404c8562ea7831d9f496" candidate_uuid: "0779b4b629ab4739a5eb616de64a0993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" is_pre_election: true
I20260809 15:40:31.670688 16768 raft_consensus.cc:2454] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0779b4b629ab4739a5eb616de64a0993 in term 0.
I20260809 15:40:31.670720 16529 raft_consensus.cc:2454] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0779b4b629ab4739a5eb616de64a0993 in term 0.
I20260809 15:40:31.671109 16230 leader_election.cc:302] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0779b4b629ab4739a5eb616de64a0993, 3723bc17abc6492ca113d5d5d8d27dc2; no voters:
I20260809 15:40:31.671401 16880 raft_consensus.cc:2781] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:31.671461 16880 raft_consensus.cc:482] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:31.671489 16880 raft_consensus.cc:3037] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.672866 16880 raft_consensus.cc:504] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.673259 16880 leader_election.cc:288] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [CANDIDATE]: Term 1 election: Requested vote from peers 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161), 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537)
I20260809 15:40:31.673703 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f216e868e66e404c8562ea7831d9f496" candidate_uuid: "0779b4b629ab4739a5eb616de64a0993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3723bc17abc6492ca113d5d5d8d27dc2"
I20260809 15:40:31.673805 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f216e868e66e404c8562ea7831d9f496" candidate_uuid: "0779b4b629ab4739a5eb616de64a0993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ac43205045429f96f78733fecf8bbd"
I20260809 15:40:31.673861 16529 raft_consensus.cc:3037] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.673955 16768 raft_consensus.cc:3037] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:31.674921 16768 raft_consensus.cc:2454] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0779b4b629ab4739a5eb616de64a0993 in term 1.
I20260809 15:40:31.674921 16529 raft_consensus.cc:2454] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0779b4b629ab4739a5eb616de64a0993 in term 1.
I20260809 15:40:31.675267 16236 leader_election.cc:302] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0779b4b629ab4739a5eb616de64a0993, 24ac43205045429f96f78733fecf8bbd; no voters:
I20260809 15:40:31.675529 16880 raft_consensus.cc:2781] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:31.675751 16880 raft_consensus.cc:686] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [term 1 LEADER]: Becoming Leader. State: Replica: 0779b4b629ab4739a5eb616de64a0993, State: Running, Role: LEADER
I20260809 15:40:31.676038 16880 consensus_queue.cc:237] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } }
I20260809 15:40:31.677385 16938 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: TxnStatusTablet state changed. Reason: New leader 0779b4b629ab4739a5eb616de64a0993. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.677517 16938 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:31.677852 16941 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:40:31.678063 16941 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:40:31.678857 16094 catalog_manager.cc:5495] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } health_report { overall_health: UNKNOWN } } }
I20260809 15:40:31.717101 16878 consensus_queue.cc:1035] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.723265 16912 consensus_queue.cc:1035] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.727280 16927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.720842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:43735 (local address 127.0.0.1:51260)
0809 15:40:31.720984 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.721001 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.721112 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.722253 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.722256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.722265 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:31.722386 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.722393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.724116 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.724120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.725051 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.725061 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.725766 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.725770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.725877 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.725937 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.726894 (+ 957us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.726911 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.726981 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.727084 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 15:40:31.727860 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.721402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51260 (local address 127.14.15.129:43735)
0809 15:40:31.721563 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.721567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.721583 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:40:31.721661 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.721664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.721739 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.721846 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:31.722541 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.723260 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.725213 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.725554 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.725659 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.726121 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.726727 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.726842 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.727714 (+ 872us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.727768 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:40:31.730633 16768 raft_consensus.cc:1261] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Refusing update from remote peer 0779b4b629ab4739a5eb616de64a0993: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:31.730808 16529 raft_consensus.cc:1261] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Refusing update from remote peer 0779b4b629ab4739a5eb616de64a0993: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:31.731259 16880 consensus_queue.cc:1035] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.731472 16938 consensus_queue.cc:1035] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:31.732798 16896 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: TxnStatusTablet state changed. Reason: New leader 0779b4b629ab4739a5eb616de64a0993. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.732831 16878 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: TxnStatusTablet state changed. Reason: New leader 0779b4b629ab4739a5eb616de64a0993. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.732919 16896 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.732926 16878 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.734970 16880 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.735116 16880 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:31.735461 16880 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.735558 16880 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 0779b4b629ab4739a5eb616de64a0993: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:31.735834 16878 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.735973 16878 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 3723bc17abc6492ca113d5d5d8d27dc2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.737437 16896 tablet_replica.cc:439] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0779b4b629ab4739a5eb616de64a0993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0779b4b629ab4739a5eb616de64a0993" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 43735 } } peers { permanent_uuid: "3723bc17abc6492ca113d5d5d8d27dc2" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34161 } } peers { permanent_uuid: "24ac43205045429f96f78733fecf8bbd" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43537 } } }
I20260809 15:40:31.737555 16896 tablet_replica.cc:442] T f216e868e66e404c8562ea7831d9f496 P 24ac43205045429f96f78733fecf8bbd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:31.749572 16937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.745010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.14.15.130:34161)
0809 15:40:31.745159 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.745164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.745323 (+ 159us) server_negotiation.cc:407] Connection header received
0809 15:40:31.745474 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.745477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.745548 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.745640 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:31.745916 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.746673 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.747928 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.748156 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.748248 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.748601 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.749068 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.749179 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.749307 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.749378 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:40:31.761669 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.757883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:44793 (local address 127.14.15.129:43735)
0809 15:40:31.758047 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.758050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.758194 (+ 144us) server_negotiation.cc:407] Connection header received
0809 15:40:31.758368 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.758370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.758416 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.758486 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:31.758780 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.759282 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.760499 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.760721 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.760803 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.761212 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.761291 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.761359 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.761492 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.761541 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 15:40:31.761716 16964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.757690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:43735 (local address 127.14.15.130:44793)
0809 15:40:31.758097 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.758114 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.758259 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.758523 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.758527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.758536 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:31.758665 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.758672 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.759406 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.759409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.760358 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.760370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.760844 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.760848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.760942 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.761002 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.761389 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.761396 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.761464 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.761550 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":176,"threads_started":1}
I20260809 15:40:31.792210 16937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.788117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:46297 (local address 127.14.15.130:34161)
0809 15:40:31.788236 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.788242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.788468 (+ 226us) server_negotiation.cc:407] Connection header received
0809 15:40:31.788626 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.788629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.788678 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.788770 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:31.789034 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.789594 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.790876 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.791232 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.791302 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.791722 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.791810 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.791893 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.792017 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.792072 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 15:40:31.792235 16971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.788038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34161 (local address 127.14.15.129:46297)
0809 15:40:31.788369 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:31.788388 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:31.788518 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:31.788780 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:31.788783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:31.788791 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:31.788918 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.788930 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.789715 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.789719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.790735 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:31.790747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.791410 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.791413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:31.791511 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.791563 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:31.791914 (+ 351us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:31.791922 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:40:31.791992 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:40:31.792084 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":113,"threads_started":1}
I20260809 15:40:31.820891 16096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:31.821097 16096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:31.823709 16096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6446304315c04253a417075135a968f7: Sending DeleteTablet for 3 replicas of tablet caf59488bda042e8871be69ed85fc3e1
I20260809 15:40:31.824424 16304 tablet_service.cc:1514] Processing DeleteTablet for tablet caf59488bda042e8871be69ed85fc3e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:51244
I20260809 15:40:31.824780 16736 tablet_service.cc:1514] Processing DeleteTablet for tablet caf59488bda042e8871be69ed85fc3e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:34616
I20260809 15:40:31.824831 16981 tablet_replica.cc:330] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: stopping tablet replica
I20260809 15:40:31.824968 16981 raft_consensus.cc:2229] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:31.825093 16981 raft_consensus.cc:2258] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.825373 16511 tablet_service.cc:1514] Processing DeleteTablet for tablet caf59488bda042e8871be69ed85fc3e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:31 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:34814
I20260809 15:40:31.825819 16981 ts_tablet_manager.cc:1905] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.826973 16983 tablet_replica.cc:330] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: stopping tablet replica
I20260809 15:40:31.827157 16983 raft_consensus.cc:2229] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:31.827543 16983 raft_consensus.cc:2258] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.828260 16983 ts_tablet_manager.cc:1905] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.829097 16981 ts_tablet_manager.cc:1918] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:31.829191 16981 log.cc:1196] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/caf59488bda042e8871be69ed85fc3e1
I20260809 15:40:31.829524 16981 ts_tablet_manager.cc:1939] T caf59488bda042e8871be69ed85fc3e1 P 0779b4b629ab4739a5eb616de64a0993: Deleting consensus metadata
I20260809 15:40:31.830279 16071 catalog_manager.cc:4841] TS 0779b4b629ab4739a5eb616de64a0993 (127.14.15.129:43735): tablet caf59488bda042e8871be69ed85fc3e1 (table test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]) successfully deleted
I20260809 15:40:31.832434 16983 ts_tablet_manager.cc:1918] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:31.832583 16983 log.cc:1196] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/caf59488bda042e8871be69ed85fc3e1
I20260809 15:40:31.832926 16983 ts_tablet_manager.cc:1939] T caf59488bda042e8871be69ed85fc3e1 P 3723bc17abc6492ca113d5d5d8d27dc2: Deleting consensus metadata
I20260809 15:40:31.833683 16071 catalog_manager.cc:4841] TS 3723bc17abc6492ca113d5d5d8d27dc2 (127.14.15.130:34161): tablet caf59488bda042e8871be69ed85fc3e1 (table test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]) successfully deleted
I20260809 15:40:31.834007 16982 tablet_replica.cc:330] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: stopping tablet replica
I20260809 15:40:31.834154 16982 raft_consensus.cc:2229] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:31.834316 16982 raft_consensus.cc:2258] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:31.835254 16982 ts_tablet_manager.cc:1905] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:31.838615 16982 ts_tablet_manager.cc:1918] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:31.838696 16982 log.cc:1196] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/caf59488bda042e8871be69ed85fc3e1
I20260809 15:40:31.838956 16982 ts_tablet_manager.cc:1939] T caf59488bda042e8871be69ed85fc3e1 P 24ac43205045429f96f78733fecf8bbd: Deleting consensus metadata
I20260809 15:40:31.839742 16075 catalog_manager.cc:4841] TS 24ac43205045429f96f78733fecf8bbd (127.14.15.131:43537): tablet caf59488bda042e8871be69ed85fc3e1 (table test-table [id=65f9d9f51b8d40cf82c81618d3cb1217]) successfully deleted
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290031, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:31.847131 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.829637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.14.15.129:43735)
0809 15:40:31.829774 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.829779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.833936 (+ 4157us) server_negotiation.cc:407] Connection header received
0809 15:40:31.834186 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.834189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.834310 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.834366 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.835632 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.836421 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.837648 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.837980 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.838049 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.842586 (+ 4537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.842596 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.842613 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.842641 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.844776 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.845344 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.845351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.845353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.845509 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.845816 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.845819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.845821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.846122 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.846362 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.846677 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.846803 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 15:40:31.847864 16385 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51276
I20260809 15:40:31.859200 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:31.849706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45626 (local address 127.14.15.190:39317)
0809 15:40:31.850171 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:31.850175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:31.850190 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:40:31.850326 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:31.850328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:31.850379 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:31.850474 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:31.851240 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.852051 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.853176 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:31.853541 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:31.853641 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:31.855255 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:31.855260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:31.855263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:31.855291 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:31.857076 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.857579 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.857582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.857584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.857686 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:31.857993 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:31.857996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:31.857998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:31.858282 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:31.858422 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:31.858666 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 15:40:31.858791 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":61,"threads_started":1}
W20260809 15:40:31.859622 16096 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45626
I20260809 15:40:31.861366 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 16206
I20260809 15:40:31.872424 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 16415
I20260809 15:40:31.884879 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 16627
I20260809 15:40:31.897645 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 16042
2026-08-09T15:40:31Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3234 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16996](info): set up 2 sockets
Aug 09 15:40:31 dist-test-slave-jztv krb5kdc[16996](info): commencing operation
krb5kdc: starting...
W20260809 15:40:33.148170 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:33.279500 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39555
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:37819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:33.396569 17013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:33.396950 17013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:33.397060 17013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:33.401399 17013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:33.401504 17013 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:40:33.401536 17013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:33.401584 17013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:33.401621 17013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:33.401656 17013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:33.407255 17013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:37819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39555
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:33.408473 17013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:33.409567 17013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:33.418871 17030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:33.418867 17026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:33.418867 17027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:33.418913 17013 server_base.cc:1034] running on GCE node
I20260809 15:40:33.419876 17013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:33.421116 17013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:33.422320 17013 hybrid_clock.cc:648] HybridClock initialized: now 1786290033422281 us; error 61 us; skew 500 ppm
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:33.429795 17013 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:33.431012 17013 webserver.cc:460] Webserver started at http://127.14.15.190:37513/ using document root <none> and password file <none>
I20260809 15:40:33.431595 17013 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:33.431659 17013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:33.431836 17013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:33.433914 17013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "1097312640944e91bf8ffe6f21f3b882"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b529cd660747f09ec6b75ff8647b34f3"
server_key_iv: "3517dc62c9c22e7f0ce952b1d5fb1da4"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.434566 17013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "1097312640944e91bf8ffe6f21f3b882"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b529cd660747f09ec6b75ff8647b34f3"
server_key_iv: "3517dc62c9c22e7f0ce952b1d5fb1da4"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.438898 17013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:40:33.441722 17037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:33.443163 17013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:33.443287 17013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "1097312640944e91bf8ffe6f21f3b882"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b529cd660747f09ec6b75ff8647b34f3"
server_key_iv: "3517dc62c9c22e7f0ce952b1d5fb1da4"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.443389 17013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:33.454308 17013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:33.457279 17013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:33.457437 17013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:33.465780 17013 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39555
I20260809 15:40:33.465803 17133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39555 every 8 connection(s)
I20260809 15:40:33.466863 17013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:33.467546 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 17013
I20260809 15:40:33.467691 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:33.467971 14398 external_mini_cluster.cc:1428] Setting key 9f03e74c2d6ddab4ec9d75d24e511ed9
I20260809 15:40:33.470270 17135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:33.477061 17135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Bootstrap starting.
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:33.480082 17135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:33.481797 17135 log.cc:824] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:33.483757 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.469287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57474 (local address 127.14.15.190:39555)
0809 15:40:33.469712 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:33.469738 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:33.469783 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:40:33.470704 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:33.470728 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:33.471150 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:33.471505 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:33.472225 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.473735 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.474708 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.475407 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.475579 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:33.478243 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:33.478253 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:33.478274 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:33.478316 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:33.480376 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.480919 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.480928 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.480937 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.481120 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.481401 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.481404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.481405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.481951 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:33.482164 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:33.482490 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 15:40:33.482815 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":118,"threads_started":1}
I20260809 15:40:33.484167 17135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: No bootstrap required, opened a new log
I20260809 15:40:33.487622 17135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } }
I20260809 15:40:33.487906 17135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:33.488003 17135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1097312640944e91bf8ffe6f21f3b882, State: Initialized, Role: FOLLOWER
I20260809 15:40:33.488404 17135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } }
I20260809 15:40:33.488545 17135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:33.488618 17135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:33.488739 17135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:33.489648 17135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } }
I20260809 15:40:33.489992 17135 leader_election.cc:302] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1097312640944e91bf8ffe6f21f3b882; no voters:
I20260809 15:40:33.490406 17135 leader_election.cc:288] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:33.490546 17140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:33.490787 17140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [term 1 LEADER]: Becoming Leader. State: Replica: 1097312640944e91bf8ffe6f21f3b882, State: Running, Role: LEADER
I20260809 15:40:33.491122 17140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } }
I20260809 15:40:33.491770 17135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:33.492933 17141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1097312640944e91bf8ffe6f21f3b882" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } } }
I20260809 15:40:33.493067 17141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:33.493294 17142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1097312640944e91bf8ffe6f21f3b882. Latest consensus state: current_term: 1 leader_uuid: "1097312640944e91bf8ffe6f21f3b882" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1097312640944e91bf8ffe6f21f3b882" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39555 } } }
I20260809 15:40:33.493398 17142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:33.494177 17154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:33.496887 17154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:33.502996 17154 catalog_manager.cc:1347] Generated new cluster ID: 9f32248c7b9a459fafeafcdc91c1347f
I20260809 15:40:33.503064 17154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:33.522258 17154 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:33.523506 17154 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:33.528981 17154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Generated new TSK 0
I20260809 15:40:33.529724 17154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:33.562458 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39555
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:37819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:33.677210 17174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:33.677536 17174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:33.677625 17174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:33.681671 17174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:33.681779 17174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:33.681854 17174 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:40:33.681903 17174 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:33.681973 17174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:33.687201 17174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:37819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:33.688290 17174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:33.689318 17174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:33.699515 17185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:33.699528 17182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:33.699702 17174 server_base.cc:1034] running on GCE node
W20260809 15:40:33.699854 17183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:33.700304 17174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:33.700976 17174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:33.702138 17174 hybrid_clock.cc:648] HybridClock initialized: now 1786290033702106 us; error 45 us; skew 500 ppm
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:33.705034 17174 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:33.705932 17174 webserver.cc:460] Webserver started at http://127.14.15.129:38877/ using document root <none> and password file <none>
I20260809 15:40:33.706589 17174 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:33.706684 17174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:33.706919 17174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:33.709040 17174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "9b8160283d526fc8460ab515b6b533fd"
server_key_iv: "d8e942cace397e944901752e8086ff20"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.709654 17174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "9b8160283d526fc8460ab515b6b533fd"
server_key_iv: "d8e942cace397e944901752e8086ff20"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.713733 17174 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:33.716945 17196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:33.718327 17174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:33.718480 17174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "9b8160283d526fc8460ab515b6b533fd"
server_key_iv: "d8e942cace397e944901752e8086ff20"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.718616 17174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:33.729385 17174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:33.732887 17174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:33.733104 17174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:33.734689 17174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:33.734766 17174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:33.734838 17174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:33.734885 17174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:33.746114 17174 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:34507
I20260809 15:40:33.746503 17369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:34507 every 8 connection(s)
I20260809 15:40:33.747251 17174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:33.749294 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.735530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:49617 (local address 127.14.15.190:39555)
0809 15:40:33.735718 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:33.735725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:33.736651 (+ 926us) server_negotiation.cc:407] Connection header received
0809 15:40:33.737922 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:33.737926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:33.738001 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:33.738100 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:33.739355 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.740011 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.741342 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.741581 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.741695 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:33.745167 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:33.745170 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:33.745173 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:33.745199 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:33.746968 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.747607 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.747611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.747613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.747740 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.748146 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.748168 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.748170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.748431 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:33.748539 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:33.749051 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 15:40:33.749173 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 15:40:33.749673 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 17174
I20260809 15:40:33.749800 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:33.750082 14398 external_mini_cluster.cc:1428] Setting key b1ab4a02177845e26c209f3f9c9f19d7
I20260809 15:40:33.750207 17209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.735923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.129:49617)
0809 15:40:33.736458 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:33.736517 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:33.737661 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:33.738351 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:33.738358 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:33.738691 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:33.739175 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:33.739188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.740203 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.740206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:33.741203 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:33.741214 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.741750 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.741754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:33.741922 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:33.742588 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:33.742612 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:33.744965 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:33.747126 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:33.747132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:33.747146 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:33.747496 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:33.747827 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:33.747831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:33.747833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:33.748054 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:33.748596 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:33.748601 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:33.748822 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 15:40:33.748977 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 15:40:33.749224 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":116,"threads_started":1}
I20260809 15:40:33.751600 17370 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39555
I20260809 15:40:33.751750 17370 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:33.752336 17370 heartbeater.cc:511] Master 127.14.15.190:39555 requested a full tablet report, sending...
I20260809 15:40:33.754011 17061 ts_manager.cc:194] Registered new tserver with Master: b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507)
I20260809 15:40:33.755435 17061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:49617
I20260809 15:40:33.762151 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.753858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.129:46685)
0809 15:40:33.754201 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:33.754240 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:33.754340 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:33.754595 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:33.754598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:33.754823 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:33.754943 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:33.754951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.755768 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.755772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:33.756707 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:33.756722 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.757317 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.757324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:33.757473 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:33.758092 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:33.758103 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:33.758494 (+ 391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:33.760615 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:33.760618 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:33.760620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:33.760810 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:33.761137 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:33.761139 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:33.761141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:33.761219 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:33.761729 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:33.761731 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:33.761806 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 15:40:33.761886 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:40:33.761995 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":3,"thread_start_us":150,"threads_started":1}
I20260809 15:40:33.762390 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.753900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:46685 (local address 127.14.15.190:39555)
0809 15:40:33.754053 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:33.754057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:33.754302 (+ 245us) server_negotiation.cc:407] Connection header received
0809 15:40:33.754420 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:33.754422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:33.754478 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:33.754543 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:33.755081 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.755661 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.756859 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:33.757170 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:33.757280 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:33.758639 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:33.758645 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:33.758651 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:33.758684 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:33.760491 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.760924 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.760929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.760930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.761034 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:33.761322 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:33.761328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:33.761333 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:33.761625 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:33.761746 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:33.762003 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 15:40:33.762152 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:33.786113 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39555
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:37819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:33.910746 17382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:33.911082 17382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:33.911175 17382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:33.915293 17382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:33.915413 17382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:33.915575 17382 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:40:33.915690 17382 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:33.915768 17382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:33.921816 17382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:37819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:33.923403 17382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:33.924556 17382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:33.935153 17394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:33.935238 17388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:33.935153 17389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:33.935652 17382 server_base.cc:1034] running on GCE node
I20260809 15:40:33.936158 17382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:33.936820 17382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:33.937991 17382 hybrid_clock.cc:648] HybridClock initialized: now 1786290033937976 us; error 29 us; skew 500 ppm
Aug 09 15:40:33 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:33.941257 17382 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:33.942323 17382 webserver.cc:460] Webserver started at http://127.14.15.130:33311/ using document root <none> and password file <none>
I20260809 15:40:33.942922 17382 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:33.943023 17382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:33.943279 17382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:33.945464 17382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "b2292be6911245f8b81ec71b4f2a4162"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b922f191b496d2ef252ff7e0b84ef96b"
server_key_iv: "4078bf68c25734225478aaa77f01bdc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.946084 17382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "b2292be6911245f8b81ec71b4f2a4162"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b922f191b496d2ef252ff7e0b84ef96b"
server_key_iv: "4078bf68c25734225478aaa77f01bdc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.950455 17382 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:33.953172 17413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:33.954562 17382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:33.954720 17382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "b2292be6911245f8b81ec71b4f2a4162"
format_stamp: "Formatted at 2026-08-09 15:40:33 on dist-test-slave-jztv"
server_key: "b922f191b496d2ef252ff7e0b84ef96b"
server_key_iv: "4078bf68c25734225478aaa77f01bdc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:33.954855 17382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:33.990929 17382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:33.994995 17382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:33.995224 17382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:33.996939 17382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:33.997046 17382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:33.997128 17382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:33.997161 17382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:34.009030 17382 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:41305
I20260809 15:40:34.009050 17571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:41305 every 8 connection(s)
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:34.010068 17382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:34.014431 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.998568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:45021 (local address 127.14.15.190:39555)
0809 15:40:33.998729 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:33.998734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:33.999761 (+ 1027us) server_negotiation.cc:407] Connection header received
0809 15:40:34.001195 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.001198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.001250 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.001328 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.003189 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.003924 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.005992 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.006283 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.006415 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.010145 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.010150 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.010153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.010185 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.012240 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.012838 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.012841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.012842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.012936 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.013315 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.013318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.013319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.013527 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.013617 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.014096 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.014287 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:40:34.014948 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 17382
I20260809 15:40:34.015060 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:34.015407 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:33.999030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.130:45021)
0809 15:40:33.999569 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:33.999635 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.000910 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.001580 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.001592 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.002162 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:34.002979 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.003006 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.004083 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.004090 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.005813 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.005827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.006520 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.006525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.006724 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.007514 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:34.007551 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:34.009941 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:34.012383 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.012388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.012401 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.012707 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.013060 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.013063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.013064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.013207 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.013634 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:34.013639 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:34.013879 (+ 240us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.014043 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.014413 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":106,"threads_started":1}
I20260809 15:40:34.015419 14398 external_mini_cluster.cc:1428] Setting key 9308dbbb9ebcf8c50f05ddca9264d341
I20260809 15:40:34.016939 17576 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39555
I20260809 15:40:34.017134 17576 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:34.017792 17576 heartbeater.cc:511] Master 127.14.15.190:39555 requested a full tablet report, sending...
I20260809 15:40:34.018989 17058 ts_manager.cc:194] Registered new tserver with Master: b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:34.019891 17058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:45021
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:34.032619 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.019280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:32919 (local address 127.14.15.190:39555)
0809 15:40:34.019461 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.019465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.019704 (+ 239us) server_negotiation.cc:407] Connection header received
0809 15:40:34.019856 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.019859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.019904 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.019993 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.020506 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.021271 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.027253 (+ 5982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.027517 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.027619 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.028848 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.028855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.028867 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.028904 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.030679 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.031228 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.031231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.031232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.031317 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.031640 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.031642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.031643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.031871 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.031951 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.032346 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.032493 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 15:40:34.032753 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.019300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.130:32919)
0809 15:40:34.019608 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.019621 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.019747 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.020082 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.020085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.020276 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:34.020377 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.020383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.026437 (+ 6054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.026441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.027073 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.027089 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.027640 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.027642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.027715 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.028255 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:34.028274 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:34.028689 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:34.030803 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.030806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.030807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.031114 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.031421 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.031426 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.031431 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.031540 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.031969 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:34.031975 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:34.032113 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.032239 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.032433 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":135,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:34.050448 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39555
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:37819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:34.166873 17586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:34.167181 17586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:34.167279 17586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:34.171475 17586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:34.171557 17586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:34.171600 17586 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:40:34.171640 17586 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:40:34.171707 17586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:34.177282 17586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:37819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:39555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:34.178483 17586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:34.179600 17586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:34.189558 17605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:34.189538 17598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:34.189538 17600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:34.189694 17586 server_base.cc:1034] running on GCE node
I20260809 15:40:34.190351 17586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:34.190961 17586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:34.192126 17586 hybrid_clock.cc:648] HybridClock initialized: now 1786290034192111 us; error 26 us; skew 500 ppm
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:34.195160 17586 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:34.196022 17586 webserver.cc:460] Webserver started at http://127.14.15.131:41317/ using document root <none> and password file <none>
I20260809 15:40:34.196599 17586 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:34.196696 17586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:34.196938 17586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:34.199086 17586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "299dc79353a644eca57ebf98c3af75a7"
format_stamp: "Formatted at 2026-08-09 15:40:34 on dist-test-slave-jztv"
server_key: "e24193fcdd0b7bfb1756c28398d8ccaf"
server_key_iv: "b94ad818609c0f41080dda5558171931"
server_key_version: "encryptionkey@0"
I20260809 15:40:34.199714 17586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "299dc79353a644eca57ebf98c3af75a7"
format_stamp: "Formatted at 2026-08-09 15:40:34 on dist-test-slave-jztv"
server_key: "e24193fcdd0b7bfb1756c28398d8ccaf"
server_key_iv: "b94ad818609c0f41080dda5558171931"
server_key_version: "encryptionkey@0"
I20260809 15:40:34.203835 17586 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:34.206473 17615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:34.207772 17586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:34.207919 17586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "299dc79353a644eca57ebf98c3af75a7"
format_stamp: "Formatted at 2026-08-09 15:40:34 on dist-test-slave-jztv"
server_key: "e24193fcdd0b7bfb1756c28398d8ccaf"
server_key_iv: "b94ad818609c0f41080dda5558171931"
server_key_version: "encryptionkey@0"
I20260809 15:40:34.208048 17586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:34.227797 17586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:34.231390 17586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:34.231613 17586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:34.233181 17586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:34.233263 17586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:34.233342 17586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:34.233390 17586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:34.245185 17586 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:40191
I20260809 15:40:34.245712 17775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:40191 every 8 connection(s)
I20260809 15:40:34.246552 17586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:34.248485 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 17586
I20260809 15:40:34.248603 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:34.248932 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.234621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:56749 (local address 127.14.15.190:39555)
0809 15:40:34.234769 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.234773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.235644 (+ 871us) server_negotiation.cc:407] Connection header received
0809 15:40:34.236931 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.236936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.237009 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.237115 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.238889 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.239570 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.240962 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.241264 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.241382 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.244339 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.244344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.244347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.244377 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.246472 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.247202 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.247205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.247207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.247309 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.247718 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.247722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.247723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.247944 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.248068 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.248621 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.248748 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:40:34.248955 14398 external_mini_cluster.cc:1428] Setting key c86bb9d6f72151d13d7ce8a9b2f2e685
I20260809 15:40:34.249861 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.234943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.131:56749)
0809 15:40:34.235481 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.235526 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.236688 (+ 1162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.237349 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.237362 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.237887 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:34.238701 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.238726 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.239727 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.239731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.240819 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.240830 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.241500 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.241505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.241680 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.242391 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:34.242433 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:34.244159 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:34.246636 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.246645 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.246661 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.247073 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.247435 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.247440 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.247444 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.247624 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.248077 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:34.248086 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:34.248361 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.248557 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.248895 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":151,"threads_started":1}
I20260809 15:40:34.253144 17777 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39555
I20260809 15:40:34.253325 17777 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:34.253942 17777 heartbeater.cc:511] Master 127.14.15.190:39555 requested a full tablet report, sending...
I20260809 15:40:34.254957 17058 ts_manager.cc:194] Registered new tserver with Master: 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191)
I20260809 15:40:34.255551 17058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:56749
I20260809 15:40:34.260835 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.253320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.14.15.131:48155)
0809 15:40:34.253666 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.253678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.253758 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.253985 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.253987 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.254246 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:34.254368 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.254374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.255266 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.255269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.255964 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.255974 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.256447 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.256450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.256545 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.257018 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:34.257032 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:34.257429 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:34.259301 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.259304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.259306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.259675 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.259962 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.259965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.259966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.260047 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.260456 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:34.260458 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:34.260530 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.260610 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.260710 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":91,"threads_started":1}
I20260809 15:40:34.260840 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.253405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:48155 (local address 127.14.15.190:39555)
0809 15:40:34.253515 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.253518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.253757 (+ 239us) server_negotiation.cc:407] Connection header received
0809 15:40:34.253822 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.253825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.253876 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.253967 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.254483 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.255142 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.256074 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.256326 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.256419 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.257584 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.257587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.257589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.257611 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.259188 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.259773 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.259776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.259777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.259856 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.260173 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.260177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.260178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.260362 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.260460 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.260648 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.260736 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:40:34.263319 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:34.294776 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.284522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.14.15.190:39555)
0809 15:40:34.284690 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.284697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.284713 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:40:34.284768 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.284771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.284824 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.284908 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.285944 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.286814 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.288094 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.288470 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.288600 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.291257 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.291261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.291263 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.291291 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.292915 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.293410 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.293413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.293414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.293499 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.293771 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.293777 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.293780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.293990 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.294105 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.294486 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.294599 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:40:34.297919 17058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:34.301054 17058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:34.316221 17812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.310205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:41305 (local address 127.0.0.1:33738)
0809 15:40:34.310952 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.310967 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.311055 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.312095 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.312098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.312118 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.312258 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.312269 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.313672 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.313675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.314868 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.314878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.315795 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.315798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.315900 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.315972 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.316043 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.316095 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":88,"thread_start_us":114,"threads_started":1}
I20260809 15:40:34.316373 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.310500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33738 (local address 127.14.15.130:41305)
0809 15:40:34.311049 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.311062 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.311189 (+ 127us) server_negotiation.cc:407] Connection header received
0809 15:40:34.311280 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.311285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.311917 (+ 632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.312119 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.312367 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.313528 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.314995 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.315662 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.315769 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.315914 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.316097 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.316198 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":126,"threads_started":1}
I20260809 15:40:34.316220 17808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.309816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40191 (local address 127.0.0.1:42448)
0809 15:40:34.310198 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.310299 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.310435 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.311343 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.311349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.311376 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.311567 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.311579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.313095 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.313101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.314301 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.314312 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.315620 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.315623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.315708 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.315787 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.315897 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.316044 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":95,"threads_started":1}
I20260809 15:40:34.316891 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.309990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42448 (local address 127.14.15.131:40191)
0809 15:40:34.310747 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.310768 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.310793 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:40:34.310874 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.310880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.311107 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.311774 (+ 667us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.311915 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.312974 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.314419 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.315272 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.315401 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.315563 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.316295 (+ 732us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.316723 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":130,"threads_started":1}
I20260809 15:40:34.317773 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.310638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34507 (local address 127.0.0.1:43164)
0809 15:40:34.311559 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.311572 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.311667 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.312317 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.312320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.312338 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.312424 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.312429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.313784 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.313788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.315265 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.315274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.317375 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.317379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.317466 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.317490 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.317557 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.317631 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260809 15:40:34.318416 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.311032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.14.15.129:34507)
0809 15:40:34.311417 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.311423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.311764 (+ 341us) server_negotiation.cc:407] Connection header received
0809 15:40:34.311842 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.311847 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.312028 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.312172 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.312553 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.313655 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.315413 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.316221 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.316323 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.318098 (+ 1775us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.318142 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.318261 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":93,"threads_started":1}
I20260809 15:40:34.319968 17479 tablet_service.cc:1467] Processing CreateTablet for tablet 20a6ffa4671d4887975f9addb41138df (DEFAULT_TABLE table=test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:34.319968 17683 tablet_service.cc:1467] Processing CreateTablet for tablet 20a6ffa4671d4887975f9addb41138df (DEFAULT_TABLE table=test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:34.320812 17269 tablet_service.cc:1467] Processing CreateTablet for tablet 20a6ffa4671d4887975f9addb41138df (DEFAULT_TABLE table=test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:34.321148 17479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20a6ffa4671d4887975f9addb41138df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.321148 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20a6ffa4671d4887975f9addb41138df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.321681 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20a6ffa4671d4887975f9addb41138df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.328471 17817 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Bootstrap starting.
I20260809 15:40:34.329792 17819 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Bootstrap starting.
I20260809 15:40:34.330482 17820 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Bootstrap starting.
I20260809 15:40:34.330798 17817 tablet_bootstrap.cc:654] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.331660 17817 log.cc:824] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:34.331914 17819 tablet_bootstrap.cc:654] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.332522 17820 tablet_bootstrap.cc:654] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.332752 17819 log.cc:824] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:34.333320 17820 log.cc:824] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:34.334350 17817 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: No bootstrap required, opened a new log
I20260809 15:40:34.334580 17817 ts_tablet_manager.cc:1397] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:40:34.334667 17819 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: No bootstrap required, opened a new log
I20260809 15:40:34.334864 17819 ts_tablet_manager.cc:1397] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:40:34.335330 17820 tablet_bootstrap.cc:492] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: No bootstrap required, opened a new log
I20260809 15:40:34.335502 17820 ts_tablet_manager.cc:1397] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:40:34.337656 17817 raft_consensus.cc:348] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.337911 17817 raft_consensus.cc:374] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.337967 17817 raft_consensus.cc:729] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.338572 17817 consensus_queue.cc:260] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.339592 17820 raft_consensus.cc:348] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.339866 17820 raft_consensus.cc:374] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.339939 17820 raft_consensus.cc:729] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.339870 17819 raft_consensus.cc:348] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.340094 17819 raft_consensus.cc:374] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.340168 17819 raft_consensus.cc:729] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b216f2e6fec64e6dbf5a84fa75e4ecfd, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.340161 17817 ts_tablet_manager.cc:1428] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:40:34.340425 17820 consensus_queue.cc:260] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.340590 17777 heartbeater.cc:503] Master 127.14.15.190:39555 was elected leader, sending a full tablet report...
I20260809 15:40:34.340541 17819 consensus_queue.cc:260] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.341068 17576 heartbeater.cc:503] Master 127.14.15.190:39555 was elected leader, sending a full tablet report...
I20260809 15:40:34.341414 17819 ts_tablet_manager.cc:1428] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:40:34.341414 17820 ts_tablet_manager.cc:1428] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260809 15:40:34.341735 17370 heartbeater.cc:503] Master 127.14.15.190:39555 was elected leader, sending a full tablet report...
W20260809 15:40:34.497816 17779 tablet.cc:2369] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:34.499194 17371 tablet.cc:2369] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:34.511355 17577 tablet.cc:2369] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:34.655591 17826 raft_consensus.cc:482] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:34.655900 17826 raft_consensus.cc:504] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.656344 17829 raft_consensus.cc:482] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:34.656553 17829 raft_consensus.cc:504] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.657313 17826 leader_election.cc:288] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:34.658661 17829 leader_election.cc:288] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191), b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507)
I20260809 15:40:34.663093 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:34785 (local address 127.14.15.131:40191)
0809 15:40:34.657972 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.657978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.658180 (+ 202us) server_negotiation.cc:407] Connection header received
0809 15:40:34.658381 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.658384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.658424 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.658471 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.659049 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660324 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.661765 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.662323 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662451 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.662506 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.662846 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.662929 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":108,"spinlock_wait_cycles":521088}
I20260809 15:40:34.663378 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:37435 (local address 127.14.15.130:41305)
0809 15:40:34.658106 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.658112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.658129 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:40:34.658185 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.658189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.658262 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.658339 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.658814 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.659644 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.661323 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.662621 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662759 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.662809 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.663148 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.663230 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":703,"server-negotiator.queue_time_us":44}
I20260809 15:40:34.663543 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.658377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34507 (local address 127.14.15.130:56853)
0809 15:40:34.658903 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.658916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.659001 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.659579 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.659583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.659618 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.659740 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.659747 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660820 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.660824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.662037 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.662045 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.663033 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.663036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.663156 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.663185 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.663237 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.663338 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":67,"thread_start_us":73,"threads_started":1}
I20260809 15:40:34.663738 17837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.658704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56853 (local address 127.14.15.129:34507)
0809 15:40:34.659316 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.659328 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.659339 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:40:34.659399 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.659401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.659445 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.659865 (+ 420us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.659980 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660700 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662166 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.662910 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.663437 (+ 527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.663483 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.663518 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.663590 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":486,"thread_start_us":104,"threads_started":1}
I20260809 15:40:34.663743 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:41305 (local address 127.14.15.131:37435)
0809 15:40:34.657717 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.657736 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.657845 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.658471 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.658474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.658487 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.658637 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.658645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.659779 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.659783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.661178 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.661190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.662751 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.662881 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.662903 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.662976 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.663046 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":138}
I20260809 15:40:34.664170 17834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34507 (local address 127.14.15.131:42635)
0809 15:40:34.658505 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.658519 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.658941 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.659344 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.659349 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.659390 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.659583 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.659591 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660620 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.660623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.661859 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.661869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.663708 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.663711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.663827 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.663860 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.663938 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.664032 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":399,"thread_start_us":153,"threads_started":1}
I20260809 15:40:34.664281 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:42635 (local address 127.14.15.129:34507)
0809 15:40:34.658005 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.658010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.658599 (+ 589us) server_negotiation.cc:407] Connection header received
0809 15:40:34.659094 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.659098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.659151 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.659200 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:34.659708 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660486 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662000 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.663129 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.663238 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.663284 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.664081 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.664165 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":457,"server-negotiator.queue_time_us":67}
I20260809 15:40:34.664394 17831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.657741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40191 (local address 127.14.15.130:34785)
0809 15:40:34.658106 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.658119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.658262 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.658622 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.658625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.658643 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:34.658916 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.658925 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.660450 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.660453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.661661 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.661672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.662587 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.662592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.662689 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.662716 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.663237 (+ 521us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.663338 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":57,"spinlock_wait_cycles":1408,"thread_start_us":91,"threads_started":1}
I20260809 15:40:34.664515 17296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:34.664659 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162" is_pre_election: true
I20260809 15:40:34.664881 17509 raft_consensus.cc:2454] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:34.664861 17296 raft_consensus.cc:2454] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:34.664877 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7" is_pre_election: true
I20260809 15:40:34.665060 17712 raft_consensus.cc:2454] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:34.664873 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:34.665242 17295 raft_consensus.cc:2454] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:34.665340 17618 leader_election.cc:302] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:34.665480 17414 leader_election.cc:302] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b216f2e6fec64e6dbf5a84fa75e4ecfd, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:34.665649 17826 raft_consensus.cc:2781] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:34.665724 17826 raft_consensus.cc:482] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:34.665766 17826 raft_consensus.cc:3037] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.665746 17829 raft_consensus.cc:2781] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:34.665824 17829 raft_consensus.cc:482] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:34.665879 17829 raft_consensus.cc:3037] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.666834 17826 raft_consensus.cc:504] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.666949 17829 raft_consensus.cc:504] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.667178 17826 leader_election.cc:288] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Requested vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:34.667282 17829 leader_election.cc:288] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Requested vote from peers 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191), b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507)
I20260809 15:40:34.667472 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:34.667604 17295 raft_consensus.cc:3037] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.667773 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162"
I20260809 15:40:34.667812 17296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:34.667881 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20a6ffa4671d4887975f9addb41138df" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7"
I20260809 15:40:34.667970 17509 raft_consensus.cc:2379] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 299dc79353a644eca57ebf98c3af75a7 in current term 1: Already voted for candidate b2292be6911245f8b81ec71b4f2a4162 in this term.
I20260809 15:40:34.668018 17712 raft_consensus.cc:2379] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2292be6911245f8b81ec71b4f2a4162 in current term 1: Already voted for candidate 299dc79353a644eca57ebf98c3af75a7 in this term.
I20260809 15:40:34.668470 17414 leader_election.cc:302] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2292be6911245f8b81ec71b4f2a4162; no voters: 299dc79353a644eca57ebf98c3af75a7, b216f2e6fec64e6dbf5a84fa75e4ecfd
I20260809 15:40:34.668679 17829 raft_consensus.cc:2726] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 15:40:34.669003 17295 raft_consensus.cc:2454] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 1.
I20260809 15:40:34.669373 17616 leader_election.cc:302] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b216f2e6fec64e6dbf5a84fa75e4ecfd; no voters: b2292be6911245f8b81ec71b4f2a4162
I20260809 15:40:34.669590 17826 raft_consensus.cc:2781] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:34.669817 17826 raft_consensus.cc:686] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Becoming Leader. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Running, Role: LEADER
I20260809 15:40:34.670169 17826 consensus_queue.cc:237] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } }
I20260809 15:40:34.673667 17060 catalog_manager.cc:5495] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131). New cstate: current_term: 1 leader_uuid: "299dc79353a644eca57ebf98c3af75a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } health_report { overall_health: UNKNOWN } } }
Aug 09 15:40:34 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:34.792649 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.784182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57496 (local address 127.14.15.190:39555)
0809 15:40:34.784343 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:34.784349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:34.784599 (+ 250us) server_negotiation.cc:407] Connection header received
0809 15:40:34.784766 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:34.784770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:34.784817 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:34.784909 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:34.785612 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.786134 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.786962 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.787180 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.787296 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.789506 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:34.789511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:34.789514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:34.789545 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:34.790796 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.791297 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.791303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.791304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.791390 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:34.791685 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:34.791690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:34.791692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:34.791873 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:34.791985 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:34.792294 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 15:40:34.792495 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":50}
I20260809 15:40:34.792649 17852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:34.784143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39555 (local address 127.0.0.1:57496)
0809 15:40:34.784485 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:34.784505 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:34.784652 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:34.784935 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:34.784938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:34.785374 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:34.785467 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.785474 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.786277 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.786282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.786837 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:34.786845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:34.787299 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:34.787302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:34.787380 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:34.787951 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:34.787963 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:34.789364 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:34.790910 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.790921 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.790928 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.791166 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.791501 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:34.791504 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:34.791506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:34.791591 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:34.791985 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:34.791993 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:34.792113 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 15:40:34.792233 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 15:40:34.792433 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":130,"threads_started":1}
I20260809 15:40:34.797179 17060 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:57496:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:40:34.797984 17060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:34.803678 17269 tablet_service.cc:1467] Processing CreateTablet for tablet 096e2a475b174072a7a67e17ed9e4c23 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f816ecc118d24b4d8be49837f8a55518]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:34.803692 17479 tablet_service.cc:1467] Processing CreateTablet for tablet 096e2a475b174072a7a67e17ed9e4c23 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f816ecc118d24b4d8be49837f8a55518]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:34.804477 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e2a475b174072a7a67e17ed9e4c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.804477 17479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e2a475b174072a7a67e17ed9e4c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.804039 17683 tablet_service.cc:1467] Processing CreateTablet for tablet 096e2a475b174072a7a67e17ed9e4c23 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f816ecc118d24b4d8be49837f8a55518]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:40:34.804802 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e2a475b174072a7a67e17ed9e4c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:34.807578 17819 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Bootstrap starting.
I20260809 15:40:34.808473 17819 tablet_bootstrap.cc:654] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.809537 17820 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: Bootstrap starting.
I20260809 15:40:34.810396 17819 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: No bootstrap required, opened a new log
I20260809 15:40:34.810487 17819 ts_tablet_manager.cc:1397] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:34.810519 17817 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: Bootstrap starting.
I20260809 15:40:34.810920 17820 tablet_bootstrap.cc:654] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.810967 17819 raft_consensus.cc:348] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.811131 17819 raft_consensus.cc:374] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.811164 17819 raft_consensus.cc:729] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b216f2e6fec64e6dbf5a84fa75e4ecfd, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.811291 17819 consensus_queue.cc:260] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.811508 17817 tablet_bootstrap.cc:654] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:34.811582 17819 ts_tablet_manager.cc:1428] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:40:34.811597 17830 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:34.811774 17830 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:34.812732 17820 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: No bootstrap required, opened a new log
I20260809 15:40:34.812848 17820 ts_tablet_manager.cc:1397] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 15:40:34.812857 17817 tablet_bootstrap.cc:492] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: No bootstrap required, opened a new log
I20260809 15:40:34.812942 17817 ts_tablet_manager.cc:1397] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:34.813421 17820 raft_consensus.cc:348] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.813443 17817 raft_consensus.cc:348] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.813548 17820 raft_consensus.cc:374] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.813570 17817 raft_consensus.cc:374] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:34.813585 17820 raft_consensus.cc:729] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.813616 17817 raft_consensus.cc:729] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Initialized, Role: FOLLOWER
I20260809 15:40:34.813709 17820 consensus_queue.cc:260] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.813740 17817 consensus_queue.cc:260] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.813992 17820 ts_tablet_manager.cc:1428] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:34.814050 17817 ts_tablet_manager.cc:1428] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:34.814023 17826 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:34.814158 17826 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:34.814184 17829 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:34.814344 17829 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:34.952803 17829 raft_consensus.cc:482] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:34.952956 17829 raft_consensus.cc:504] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.953476 17829 leader_election.cc:288] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191)
I20260809 15:40:34.954066 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e2a475b174072a7a67e17ed9e4c23" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:34.954099 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e2a475b174072a7a67e17ed9e4c23" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7" is_pre_election: true
I20260809 15:40:34.954269 17295 raft_consensus.cc:2454] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:34.954308 17712 raft_consensus.cc:2454] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:34.954643 17414 leader_election.cc:302] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:34.954857 17829 raft_consensus.cc:2781] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:34.954936 17829 raft_consensus.cc:482] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:34.954996 17829 raft_consensus.cc:3037] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.956002 17829 raft_consensus.cc:504] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.956346 17829 leader_election.cc:288] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Requested vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191)
I20260809 15:40:34.956782 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e2a475b174072a7a67e17ed9e4c23" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:34.956894 17295 raft_consensus.cc:3037] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.956854 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e2a475b174072a7a67e17ed9e4c23" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7"
I20260809 15:40:34.957005 17712 raft_consensus.cc:3037] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:34.957962 17295 raft_consensus.cc:2454] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 1.
I20260809 15:40:34.958268 17712 raft_consensus.cc:2454] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 1.
I20260809 15:40:34.958338 17414 leader_election.cc:302] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b216f2e6fec64e6dbf5a84fa75e4ecfd, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:34.958513 17829 raft_consensus.cc:2781] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:34.958731 17829 raft_consensus.cc:686] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [term 1 LEADER]: Becoming Leader. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Running, Role: LEADER
I20260809 15:40:34.959242 17829 consensus_queue.cc:237] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:34.961704 17856 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: TxnStatusTablet state changed. Reason: New leader b2292be6911245f8b81ec71b4f2a4162. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:34.961818 17856 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:34.962145 17858 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:40:34.962389 17858 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:40:34.962854 17058 catalog_manager.cc:5495] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260809 15:40:35.007017 17852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.002673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:41305 (local address 127.0.0.1:33754)
0809 15:40:35.002891 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:35.002904 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:35.002994 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:35.003349 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:35.003351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:35.003357 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:35.003451 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.003455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.004457 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.004460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.005156 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.005166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.005744 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.005747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.005819 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.005880 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.006741 (+ 861us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.006756 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 15:40:35.006822 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 15:40:35.006898 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 15:40:35.007064 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.002800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33754 (local address 127.14.15.130:41305)
0809 15:40:35.002935 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:35.002940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:35.002956 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:40:35.003153 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:35.003156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:35.003228 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:35.003335 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:35.003563 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.004349 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.005263 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.005606 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.005716 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.006060 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.006637 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.006777 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:35.006842 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 15:40:35.006916 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:40:35.012184 17712 raft_consensus.cc:1261] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Refusing update from remote peer b2292be6911245f8b81ec71b4f2a4162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.012204 17295 raft_consensus.cc:1261] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Refusing update from remote peer b2292be6911245f8b81ec71b4f2a4162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.012844 17829 consensus_queue.cc:1035] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:35.013337 17856 consensus_queue.cc:1035] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:35.016646 17826 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: TxnStatusTablet state changed. Reason: New leader b2292be6911245f8b81ec71b4f2a4162. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.016788 17826 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:35.017937 17830 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: TxnStatusTablet state changed. Reason: New leader b2292be6911245f8b81ec71b4f2a4162. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.018067 17830 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:35.022255 17826 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.022378 17826 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P 299dc79353a644eca57ebf98c3af75a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:35.022773 17868 mvcc.cc:205] Tried to move back new op lower bound from 7316643983403515904 to 7316643983195992064. Current Snapshot: MvccSnapshot[applied={T|T < 7316643983403515904}]
I20260809 15:40:35.023509 17829 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.023644 17829 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:35.025643 17865 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.025838 17865 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b2292be6911245f8b81ec71b4f2a4162: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:40:35.025765 17830 tablet_replica.cc:439] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } } }
I20260809 15:40:35.025878 17830 tablet_replica.cc:442] T 096e2a475b174072a7a67e17ed9e4c23 P b216f2e6fec64e6dbf5a84fa75e4ecfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:40:35.026078 17869 mvcc.cc:205] Tried to move back new op lower bound from 7316643983403515904 to 7316643983195992064. Current Snapshot: MvccSnapshot[applied={T|T < 7316643983403515904}]
I20260809 15:40:35.033985 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.029668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42460 (local address 127.14.15.131:40191)
0809 15:40:35.029811 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:35.029818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:35.029835 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:40:35.030063 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:35.030067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:35.030137 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:35.030310 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:35.030613 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.031389 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.032335 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.032685 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.032794 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.033035 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.033584 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.033710 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:35.033780 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 15:40:35.033844 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:40:35.045706 17885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.041762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:41305 (local address 127.14.15.131:36973)
0809 15:40:35.042069 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:35.042083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:35.042173 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:35.042536 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:35.042539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:35.042547 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:35.042659 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.042664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.043686 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.043689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.044355 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.044364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.044949 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.044952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.045024 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.045068 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.045400 (+ 332us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.045405 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:40:35.045456 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 15:40:35.045573 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":120,"threads_started":1}
I20260809 15:40:35.045699 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.041864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:36973 (local address 127.14.15.130:41305)
0809 15:40:35.041995 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:35.042000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:35.042163 (+ 163us) server_negotiation.cc:407] Connection header received
0809 15:40:35.042343 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:35.042347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:35.042404 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:35.042490 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:35.042784 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.043556 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.044490 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.044792 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.044897 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.045231 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.045307 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.045378 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:35.045500 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 15:40:35.045555 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:40:35.053848 17295 raft_consensus.cc:1261] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.054143 17509 raft_consensus.cc:1261] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.054527 17886 consensus_queue.cc:1035] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:35.054708 17826 consensus_queue.cc:1035] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:35.059973 17864 mvcc.cc:205] Tried to move back new op lower bound from 7316643983576854528 to 7316643982012178432. Current Snapshot: MvccSnapshot[applied={T|T < 7316643983576854528}]
I20260809 15:40:35.081964 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.074346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:41173 (local address 127.14.15.131:40191)
0809 15:40:35.074488 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:35.074493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:35.078603 (+ 4110us) server_negotiation.cc:407] Connection header received
0809 15:40:35.078728 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:35.078731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:35.078792 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:35.078873 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:35.079184 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.079815 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.080776 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.081060 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.081167 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.081460 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.081546 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.081639 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:35.081763 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:40:35.081820 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:40:35.082002 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:35.074200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40191 (local address 127.14.15.130:41173)
0809 15:40:35.078478 (+ 4278us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:35.078495 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:35.078622 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:35.078903 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:35.078906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:35.078915 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:35.079028 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.079039 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.079935 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.079937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.080646 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:35.080655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:35.081182 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:35.081186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:35.081273 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:35.081318 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:35.081642 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:35.081651 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:40:35.081739 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:40:35.081822 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4147,"thread_start_us":113,"threads_started":1}
I20260809 15:40:35.113855 17058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:35.114077 17058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:35.116601 17058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Sending DeleteTablet for 3 replicas of tablet 20a6ffa4671d4887975f9addb41138df
I20260809 15:40:35.117518 17269 tablet_service.cc:1514] Processing DeleteTablet for tablet 20a6ffa4671d4887975f9addb41138df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:35 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43164
I20260809 15:40:35.117700 17479 tablet_service.cc:1514] Processing DeleteTablet for tablet 20a6ffa4671d4887975f9addb41138df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:35 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:33738
I20260809 15:40:35.118260 17899 tablet_replica.cc:330] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: stopping tablet replica
I20260809 15:40:35.118299 17683 tablet_service.cc:1514] Processing DeleteTablet for tablet 20a6ffa4671d4887975f9addb41138df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:35 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:42448
I20260809 15:40:35.118732 17899 raft_consensus.cc:2229] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:35.118968 17899 raft_consensus.cc:2258] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:35.119633 17058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:35.120090 17058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:35.120734 17899 ts_tablet_manager.cc:1905] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:35.124266 17899 ts_tablet_manager.cc:1918] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:35.124466 17899 log.cc:1196] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/20a6ffa4671d4887975f9addb41138df
I20260809 15:40:35.124931 17899 ts_tablet_manager.cc:1939] T 20a6ffa4671d4887975f9addb41138df P b2292be6911245f8b81ec71b4f2a4162: Deleting consensus metadata
I20260809 15:40:35.126454 17479 tablet_service.cc:1467] Processing CreateTablet for tablet 82cbf938d04441b8950cdecb67b74660 (DEFAULT_TABLE table=test-table [id=f81546781dd54d7e8c9ed09f8c67f896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:35.126456 17683 tablet_service.cc:1467] Processing CreateTablet for tablet 82cbf938d04441b8950cdecb67b74660 (DEFAULT_TABLE table=test-table [id=f81546781dd54d7e8c9ed09f8c67f896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:35.126722 17479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cbf938d04441b8950cdecb67b74660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:35.126724 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cbf938d04441b8950cdecb67b74660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:35.129105 17820 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Bootstrap starting.
I20260809 15:40:35.129169 17817 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Bootstrap starting.
I20260809 15:40:35.130069 17820 tablet_bootstrap.cc:654] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:35.130081 17817 tablet_bootstrap.cc:654] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:35.131148 17269 tablet_service.cc:1467] Processing CreateTablet for tablet 82cbf938d04441b8950cdecb67b74660 (DEFAULT_TABLE table=test-table [id=f81546781dd54d7e8c9ed09f8c67f896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:35.131470 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cbf938d04441b8950cdecb67b74660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:35.131436 17042 catalog_manager.cc:4841] TS b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305): tablet 20a6ffa4671d4887975f9addb41138df (table test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]) successfully deleted
I20260809 15:40:35.133606 17819 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Bootstrap starting.
I20260809 15:40:35.134629 17819 tablet_bootstrap.cc:654] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:35.134753 17898 tablet_replica.cc:330] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: stopping tablet replica
I20260809 15:40:35.135126 17898 raft_consensus.cc:2229] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:35.135388 17898 raft_consensus.cc:2258] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:35.135804 17900 tablet_replica.cc:330] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: stopping tablet replica
I20260809 15:40:35.136164 17819 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: No bootstrap required, opened a new log
I20260809 15:40:35.136246 17819 ts_tablet_manager.cc:1397] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:35.136757 17819 raft_consensus.cc:348] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.136880 17819 raft_consensus.cc:374] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:35.136916 17819 raft_consensus.cc:729] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b216f2e6fec64e6dbf5a84fa75e4ecfd, State: Initialized, Role: FOLLOWER
I20260809 15:40:35.137040 17819 consensus_queue.cc:260] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.137356 17819 ts_tablet_manager.cc:1428] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:35.138140 17898 ts_tablet_manager.cc:1905] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:35.138964 17817 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: No bootstrap required, opened a new log
I20260809 15:40:35.139060 17817 ts_tablet_manager.cc:1397] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20260809 15:40:35.139473 17900 raft_consensus.cc:2229] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:35.139540 17817 raft_consensus.cc:348] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.139660 17817 raft_consensus.cc:374] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:35.139693 17817 raft_consensus.cc:729] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Initialized, Role: FOLLOWER
I20260809 15:40:35.139838 17900 raft_consensus.cc:2258] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:35.139838 17817 consensus_queue.cc:260] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.140199 17817 ts_tablet_manager.cc:1428] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:35.140643 17820 tablet_bootstrap.cc:492] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: No bootstrap required, opened a new log
I20260809 15:40:35.140748 17820 ts_tablet_manager.cc:1397] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260809 15:40:35.141186 17820 raft_consensus.cc:348] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.141304 17820 raft_consensus.cc:374] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:35.141337 17820 raft_consensus.cc:729] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Initialized, Role: FOLLOWER
I20260809 15:40:35.141453 17820 consensus_queue.cc:260] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.141687 17820 ts_tablet_manager.cc:1428] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:35.141202 17900 ts_tablet_manager.cc:1905] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:35.147771 17900 ts_tablet_manager.cc:1918] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:35.147894 17900 log.cc:1196] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/20a6ffa4671d4887975f9addb41138df
I20260809 15:40:35.148267 17900 ts_tablet_manager.cc:1939] T 20a6ffa4671d4887975f9addb41138df P 299dc79353a644eca57ebf98c3af75a7: Deleting consensus metadata
I20260809 15:40:35.149295 17886 raft_consensus.cc:482] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:35.149382 17886 raft_consensus.cc:504] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.149569 17040 catalog_manager.cc:4841] TS 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191): tablet 20a6ffa4671d4887975f9addb41138df (table test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]) successfully deleted
I20260809 15:40:35.149796 17886 leader_election.cc:288] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:35.150106 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cbf938d04441b8950cdecb67b74660" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:35.150322 17295 raft_consensus.cc:2454] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:35.150524 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cbf938d04441b8950cdecb67b74660" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162" is_pre_election: true
I20260809 15:40:35.150640 17616 leader_election.cc:302] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b216f2e6fec64e6dbf5a84fa75e4ecfd; no voters:
I20260809 15:40:35.150686 17509 raft_consensus.cc:2454] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:35.150817 17886 raft_consensus.cc:2781] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:35.150857 17886 raft_consensus.cc:482] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:35.150890 17886 raft_consensus.cc:3037] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:35.151988 17886 raft_consensus.cc:504] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.152397 17886 leader_election.cc:288] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Requested vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:35.152679 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cbf938d04441b8950cdecb67b74660" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:35.152729 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cbf938d04441b8950cdecb67b74660" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162"
I20260809 15:40:35.152798 17295 raft_consensus.cc:3037] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:35.152840 17509 raft_consensus.cc:3037] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:35.153512 17898 ts_tablet_manager.cc:1918] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:35.153616 17898 log.cc:1196] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/20a6ffa4671d4887975f9addb41138df
I20260809 15:40:35.153882 17295 raft_consensus.cc:2454] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 1.
I20260809 15:40:35.153913 17509 raft_consensus.cc:2454] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 1.
I20260809 15:40:35.153967 17898 ts_tablet_manager.cc:1939] T 20a6ffa4671d4887975f9addb41138df P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting consensus metadata
I20260809 15:40:35.154201 17618 leader_election.cc:302] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:35.154383 17886 raft_consensus.cc:2781] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:35.154443 17886 raft_consensus.cc:686] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Becoming Leader. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Running, Role: LEADER
I20260809 15:40:35.154562 17886 consensus_queue.cc:237] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:35.155293 17040 catalog_manager.cc:4841] TS b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507): tablet 20a6ffa4671d4887975f9addb41138df (table test-table [id=6becf9f3ac9046fa8a6203e17c8b37c4]) successfully deleted
I20260809 15:40:35.156221 17058 catalog_manager.cc:5495] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131). New cstate: current_term: 1 leader_uuid: "299dc79353a644eca57ebf98c3af75a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260809 15:40:35.177870 17509 raft_consensus.cc:1261] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.178359 17886 consensus_queue.cc:1035] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:35.178555 17295 raft_consensus.cc:1261] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:35.179001 17886 consensus_queue.cc:1035] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:40:35.194615 17868 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 15:40:36.762243 17058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:36.762466 17058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:36.765100 17058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Sending DeleteTablet for 3 replicas of tablet 82cbf938d04441b8950cdecb67b74660
I20260809 15:40:36.765714 17683 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cbf938d04441b8950cdecb67b74660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:36 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:42448
I20260809 15:40:36.765714 17269 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cbf938d04441b8950cdecb67b74660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:36 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43164
I20260809 15:40:36.765733 17479 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cbf938d04441b8950cdecb67b74660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:36 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:33738
I20260809 15:40:36.766088 17948 tablet_replica.cc:330] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: stopping tablet replica
I20260809 15:40:36.766281 17948 raft_consensus.cc:2229] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:36.766371 17947 tablet_replica.cc:330] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: stopping tablet replica
I20260809 15:40:36.766530 17947 raft_consensus.cc:2229] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:36.766559 17948 raft_consensus.cc:2258] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:36.766678 17949 tablet_replica.cc:330] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: stopping tablet replica
I20260809 15:40:36.766728 17947 raft_consensus.cc:2258] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:36.766921 17949 raft_consensus.cc:2229] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:36.767117 17949 raft_consensus.cc:2258] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:36.767326 17948 ts_tablet_manager.cc:1905] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:36.767335 17947 ts_tablet_manager.cc:1905] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:36.767938 17949 ts_tablet_manager.cc:1905] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:36.769989 17948 ts_tablet_manager.cc:1918] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:40:36.769989 17947 ts_tablet_manager.cc:1918] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:40:36.770082 17947 log.cc:1196] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/82cbf938d04441b8950cdecb67b74660
I20260809 15:40:36.770113 17948 log.cc:1196] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/82cbf938d04441b8950cdecb67b74660
I20260809 15:40:36.770471 17948 ts_tablet_manager.cc:1939] T 82cbf938d04441b8950cdecb67b74660 P 299dc79353a644eca57ebf98c3af75a7: Deleting consensus metadata
I20260809 15:40:36.770474 17947 ts_tablet_manager.cc:1939] T 82cbf938d04441b8950cdecb67b74660 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting consensus metadata
I20260809 15:40:36.771131 17040 catalog_manager.cc:4841] TS 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191): tablet 82cbf938d04441b8950cdecb67b74660 (table test-table [id=f81546781dd54d7e8c9ed09f8c67f896]) successfully deleted
I20260809 15:40:36.771330 17040 catalog_manager.cc:4841] TS b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507): tablet 82cbf938d04441b8950cdecb67b74660 (table test-table [id=f81546781dd54d7e8c9ed09f8c67f896]) successfully deleted
I20260809 15:40:36.771616 17949 ts_tablet_manager.cc:1918] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:40:36.771709 17949 log.cc:1196] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/82cbf938d04441b8950cdecb67b74660
I20260809 15:40:36.771997 17949 ts_tablet_manager.cc:1939] T 82cbf938d04441b8950cdecb67b74660 P b2292be6911245f8b81ec71b4f2a4162: Deleting consensus metadata
I20260809 15:40:36.772773 17042 catalog_manager.cc:4841] TS b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305): tablet 82cbf938d04441b8950cdecb67b74660 (table test-table [id=f81546781dd54d7e8c9ed09f8c67f896]) successfully deleted
Aug 09 15:40:36 dist-test-slave-jztv krb5kdc[16996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:40:36 dist-test-slave-jztv krb5kdc[16996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:36.796082 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:36.787207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50378 (local address 127.14.15.190:39555)
0809 15:40:36.787528 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:36.787534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:36.787549 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:40:36.787604 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:36.787606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:36.787648 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:36.787726 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:36.788409 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.788964 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.789768 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.789998 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.790070 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:36.792774 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:36.792777 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:36.792779 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:36.792803 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:36.794466 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:36.794950 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:36.794953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:36.794954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:36.795040 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:36.795307 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:36.795310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:36.795311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:36.795490 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:36.795596 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:36.795831 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 15:40:36.795938 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":120,"threads_started":1}
I20260809 15:40:36.798950 17058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:36.799439 17058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:36.804304 17269 tablet_service.cc:1467] Processing CreateTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e (DEFAULT_TABLE table=test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:36.804513 17479 tablet_service.cc:1467] Processing CreateTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e (DEFAULT_TABLE table=test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:36.804505 17683 tablet_service.cc:1467] Processing CreateTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e (DEFAULT_TABLE table=test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:36.804703 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5b0c5b343e54ec58264eedcfbf51d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:36.804795 17479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5b0c5b343e54ec58264eedcfbf51d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:36.804795 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5b0c5b343e54ec58264eedcfbf51d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:36.807578 17962 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Bootstrap starting.
I20260809 15:40:36.807672 17961 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Bootstrap starting.
I20260809 15:40:36.808050 17960 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Bootstrap starting.
I20260809 15:40:36.808544 17961 tablet_bootstrap.cc:654] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:36.808544 17962 tablet_bootstrap.cc:654] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:36.809330 17960 tablet_bootstrap.cc:654] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:36.810007 17961 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: No bootstrap required, opened a new log
I20260809 15:40:36.810148 17961 ts_tablet_manager.cc:1397] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:36.810422 17962 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: No bootstrap required, opened a new log
I20260809 15:40:36.810549 17962 ts_tablet_manager.cc:1397] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:36.810786 17960 tablet_bootstrap.cc:492] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: No bootstrap required, opened a new log
I20260809 15:40:36.810946 17960 ts_tablet_manager.cc:1397] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:36.810755 17961 raft_consensus.cc:348] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.811061 17961 raft_consensus.cc:374] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:36.811129 17961 raft_consensus.cc:729] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Initialized, Role: FOLLOWER
I20260809 15:40:36.811235 17962 raft_consensus.cc:348] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.811307 17961 consensus_queue.cc:260] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.811372 17962 raft_consensus.cc:374] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:36.811587 17962 raft_consensus.cc:729] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Initialized, Role: FOLLOWER
I20260809 15:40:36.811621 17961 ts_tablet_manager.cc:1428] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:36.811583 17960 raft_consensus.cc:348] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.811704 17960 raft_consensus.cc:374] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:36.811743 17960 raft_consensus.cc:729] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b216f2e6fec64e6dbf5a84fa75e4ecfd, State: Initialized, Role: FOLLOWER
I20260809 15:40:36.811775 17962 consensus_queue.cc:260] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.811888 17960 consensus_queue.cc:260] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.812276 17960 ts_tablet_manager.cc:1428] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:40:36.812747 17962 ts_tablet_manager.cc:1428] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:36.944996 17912 raft_consensus.cc:482] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:36.945173 17912 raft_consensus.cc:504] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.945608 17912 leader_election.cc:288] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191)
I20260809 15:40:36.946269 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5b0c5b343e54ec58264eedcfbf51d6e" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:36.946264 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5b0c5b343e54ec58264eedcfbf51d6e" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7" is_pre_election: true
I20260809 15:40:36.946434 17295 raft_consensus.cc:2454] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:36.946434 17712 raft_consensus.cc:2454] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 0.
I20260809 15:40:36.946817 17414 leader_election.cc:302] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:36.947011 17912 raft_consensus.cc:2781] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:36.947074 17912 raft_consensus.cc:482] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:36.947124 17912 raft_consensus.cc:3037] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:36.948349 17912 raft_consensus.cc:504] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.948665 17912 leader_election.cc:288] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Requested vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191)
I20260809 15:40:36.949079 17295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5b0c5b343e54ec58264eedcfbf51d6e" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:36.949072 17712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5b0c5b343e54ec58264eedcfbf51d6e" candidate_uuid: "b2292be6911245f8b81ec71b4f2a4162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299dc79353a644eca57ebf98c3af75a7"
I20260809 15:40:36.949225 17295 raft_consensus.cc:3037] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:36.949225 17712 raft_consensus.cc:3037] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:36.950500 17712 raft_consensus.cc:2454] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 1.
I20260809 15:40:36.950500 17295 raft_consensus.cc:2454] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2292be6911245f8b81ec71b4f2a4162 in term 1.
I20260809 15:40:36.950873 17414 leader_election.cc:302] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b216f2e6fec64e6dbf5a84fa75e4ecfd, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:36.951085 17912 raft_consensus.cc:2781] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:36.951205 17912 raft_consensus.cc:686] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 1 LEADER]: Becoming Leader. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Running, Role: LEADER
I20260809 15:40:36.951380 17912 consensus_queue.cc:237] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:36.953244 17058 catalog_manager.cc:5495] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "b2292be6911245f8b81ec71b4f2a4162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260809 15:40:36.970309 17972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:36.967076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53374 (local address 127.14.15.130:41305)
0809 15:40:36.967311 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:36.967318 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:36.967329 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:40:36.967368 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:36.967371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:36.967409 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:36.967488 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:36.967816 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.968363 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.969246 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.969476 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.969564 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:36.969825 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:36.969906 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:36.969966 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:36.970058 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 15:40:36.970115 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":105,"threads_started":1}
I20260809 15:40:36.979650 17972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:36.976556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:59495 (local address 127.14.15.130:41305)
0809 15:40:36.976645 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:36.976651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:36.976665 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:40:36.976818 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:36.976821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:36.976864 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:36.976945 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:36.977179 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.977680 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.978605 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.978831 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.978938 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:36.979169 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:36.979248 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:36.979325 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:36.979424 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 15:40:36.979477 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 15:40:36.979650 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:36.976308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:41305 (local address 127.14.15.130:59495)
0809 15:40:36.976595 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:36.976611 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:36.976710 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:36.976953 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:36.976956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:36.976963 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:40:36.977066 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:36.977079 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.977784 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.977790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:36.978488 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:36.978497 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:36.978939 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:36.978942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:36.979019 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:36.979051 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:40:36.979328 (+ 277us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:40:36.979336 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:40:36.979417 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:40:36.979498 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":4,"thread_start_us":125,"threads_started":1}
I20260809 15:40:36.985185 17712 raft_consensus.cc:1261] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Refusing update from remote peer b2292be6911245f8b81ec71b4f2a4162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:36.985216 17295 raft_consensus.cc:1261] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Refusing update from remote peer b2292be6911245f8b81ec71b4f2a4162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:36.985612 17920 consensus_queue.cc:1035] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:36.985831 17829 consensus_queue.cc:1035] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:37.025331 17061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:37.025517 17061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:37.027935 17061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Sending DeleteTablet for 3 replicas of tablet b5b0c5b343e54ec58264eedcfbf51d6e
I20260809 15:40:37.028609 17479 tablet_service.cc:1514] Processing DeleteTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:37 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:33738
I20260809 15:40:37.028782 17949 tablet_replica.cc:330] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: stopping tablet replica
I20260809 15:40:37.028754 17269 tablet_service.cc:1514] Processing DeleteTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:37 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43164
I20260809 15:40:37.028862 17683 tablet_service.cc:1514] Processing DeleteTablet for tablet b5b0c5b343e54ec58264eedcfbf51d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:37 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:42448
I20260809 15:40:37.028914 17949 raft_consensus.cc:2229] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:37.028949 17947 tablet_replica.cc:330] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: stopping tablet replica
I20260809 15:40:37.029064 17947 raft_consensus.cc:2229] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:37.029187 17948 tablet_replica.cc:330] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: stopping tablet replica
I20260809 15:40:37.029187 17947 raft_consensus.cc:2258] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:37.029206 17949 raft_consensus.cc:2258] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:37.029300 17948 raft_consensus.cc:2229] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:37.029238 17061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 15:40:37.029417 17948 raft_consensus.cc:2258] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:40:37.029626 17061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:37.030293 17947 ts_tablet_manager.cc:1905] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:37.031845 17949 ts_tablet_manager.cc:1905] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:37.032919 17947 ts_tablet_manager.cc:1918] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:37.032989 17947 log.cc:1196] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/b5b0c5b343e54ec58264eedcfbf51d6e
I20260809 15:40:37.033260 17947 ts_tablet_manager.cc:1939] T b5b0c5b343e54ec58264eedcfbf51d6e P b216f2e6fec64e6dbf5a84fa75e4ecfd: Deleting consensus metadata
I20260809 15:40:37.034153 17040 catalog_manager.cc:4841] TS b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507): tablet b5b0c5b343e54ec58264eedcfbf51d6e (table test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]) successfully deleted
I20260809 15:40:37.034554 17948 ts_tablet_manager.cc:1905] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:37.034588 17949 ts_tablet_manager.cc:1918] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:37.034652 17949 log.cc:1196] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/b5b0c5b343e54ec58264eedcfbf51d6e
I20260809 15:40:37.034727 17479 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 (DEFAULT_TABLE table=test-table [id=7a2f439a6e4c4a1d9033580d2013fc37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:37.034857 17683 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 (DEFAULT_TABLE table=test-table [id=7a2f439a6e4c4a1d9033580d2013fc37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:37.034932 17949 ts_tablet_manager.cc:1939] T b5b0c5b343e54ec58264eedcfbf51d6e P b2292be6911245f8b81ec71b4f2a4162: Deleting consensus metadata
I20260809 15:40:37.034986 17479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb7b2e7307a46959c61f75736c049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:37.035109 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb7b2e7307a46959c61f75736c049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:37.037142 17948 ts_tablet_manager.cc:1918] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:40:37.037226 17948 log.cc:1196] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/b5b0c5b343e54ec58264eedcfbf51d6e
I20260809 15:40:37.037279 17961 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Bootstrap starting.
I20260809 15:40:37.037508 17948 ts_tablet_manager.cc:1939] T b5b0c5b343e54ec58264eedcfbf51d6e P 299dc79353a644eca57ebf98c3af75a7: Deleting consensus metadata
I20260809 15:40:37.037497 17042 catalog_manager.cc:4841] TS b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305): tablet b5b0c5b343e54ec58264eedcfbf51d6e (table test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]) successfully deleted
I20260809 15:40:37.037830 17269 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 (DEFAULT_TABLE table=test-table [id=7a2f439a6e4c4a1d9033580d2013fc37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:37.038120 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb7b2e7307a46959c61f75736c049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:37.038165 17961 tablet_bootstrap.cc:654] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:37.038757 17040 catalog_manager.cc:4841] TS 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191): tablet b5b0c5b343e54ec58264eedcfbf51d6e (table test-table [id=5f9d294b8a174ab9b0a68dbdf5f7d5c4]) successfully deleted
I20260809 15:40:37.038797 17962 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Bootstrap starting.
I20260809 15:40:37.039669 17962 tablet_bootstrap.cc:654] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:37.040048 17961 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: No bootstrap required, opened a new log
I20260809 15:40:37.040141 17961 ts_tablet_manager.cc:1397] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 15:40:37.040532 17960 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Bootstrap starting.
I20260809 15:40:37.040537 17961 raft_consensus.cc:348] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.040663 17961 raft_consensus.cc:374] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:37.040707 17961 raft_consensus.cc:729] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2292be6911245f8b81ec71b4f2a4162, State: Initialized, Role: FOLLOWER
I20260809 15:40:37.040845 17961 consensus_queue.cc:260] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.041109 17961 ts_tablet_manager.cc:1428] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:37.041412 17962 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: No bootstrap required, opened a new log
I20260809 15:40:37.041518 17962 ts_tablet_manager.cc:1397] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 15:40:37.041548 17960 tablet_bootstrap.cc:654] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:37.041960 17962 raft_consensus.cc:348] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.042122 17962 raft_consensus.cc:374] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:37.042172 17962 raft_consensus.cc:729] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Initialized, Role: FOLLOWER
I20260809 15:40:37.042332 17962 consensus_queue.cc:260] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.043111 17960 tablet_bootstrap.cc:492] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd: No bootstrap required, opened a new log
I20260809 15:40:37.043205 17960 ts_tablet_manager.cc:1397] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:37.043658 17960 raft_consensus.cc:348] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.043776 17960 raft_consensus.cc:374] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:37.043816 17960 raft_consensus.cc:729] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b216f2e6fec64e6dbf5a84fa75e4ecfd, State: Initialized, Role: FOLLOWER
I20260809 15:40:37.043941 17960 consensus_queue.cc:260] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.044035 17962 ts_tablet_manager.cc:1428] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 15:40:37.044238 17960 ts_tablet_manager.cc:1428] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:40:37.272969 17936 raft_consensus.cc:482] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:37.273130 17936 raft_consensus.cc:504] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.273550 17936 leader_election.cc:288] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:37.274085 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb7b2e7307a46959c61f75736c049e1" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162" is_pre_election: true
I20260809 15:40:37.274102 17296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb7b2e7307a46959c61f75736c049e1" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" is_pre_election: true
I20260809 15:40:37.274302 17296 raft_consensus.cc:2454] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:37.274310 17509 raft_consensus.cc:2454] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 0.
I20260809 15:40:37.274691 17616 leader_election.cc:302] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b216f2e6fec64e6dbf5a84fa75e4ecfd; no voters:
I20260809 15:40:37.274927 17936 raft_consensus.cc:2781] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:37.274996 17936 raft_consensus.cc:482] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:37.275046 17936 raft_consensus.cc:3037] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:37.276088 17936 raft_consensus.cc:504] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.276481 17936 leader_election.cc:288] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Requested vote from peers b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507), b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305)
I20260809 15:40:37.276889 17296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb7b2e7307a46959c61f75736c049e1" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd"
I20260809 15:40:37.276934 17509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb7b2e7307a46959c61f75736c049e1" candidate_uuid: "299dc79353a644eca57ebf98c3af75a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2292be6911245f8b81ec71b4f2a4162"
I20260809 15:40:37.277032 17296 raft_consensus.cc:3037] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:37.277063 17509 raft_consensus.cc:3037] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:37.278069 17509 raft_consensus.cc:2454] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 1.
I20260809 15:40:37.278075 17296 raft_consensus.cc:2454] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 299dc79353a644eca57ebf98c3af75a7 in term 1.
I20260809 15:40:37.278378 17618 leader_election.cc:302] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299dc79353a644eca57ebf98c3af75a7, b2292be6911245f8b81ec71b4f2a4162; no voters:
I20260809 15:40:37.278555 17936 raft_consensus.cc:2781] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:37.278754 17936 raft_consensus.cc:686] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Becoming Leader. State: Replica: 299dc79353a644eca57ebf98c3af75a7, State: Running, Role: LEADER
I20260809 15:40:37.279026 17936 consensus_queue.cc:237] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } }
I20260809 15:40:37.280706 17061 catalog_manager.cc:5495] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131). New cstate: current_term: 1 leader_uuid: "299dc79353a644eca57ebf98c3af75a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299dc79353a644eca57ebf98c3af75a7" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260809 15:40:37.349821 17997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:37.346529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45762 (local address 127.14.15.131:40191)
0809 15:40:37.346821 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:37.346848 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:37.346861 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:40:37.346900 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:37.346902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:37.346943 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:37.347017 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:37.347324 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:37.347900 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:37.348814 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:37.349062 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:37.349149 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:37.349436 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:37.349507 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:37.349565 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:37.349653 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 15:40:37.349699 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
I20260809 15:40:37.356423 17296 raft_consensus.cc:1261] T 6fb7b2e7307a46959c61f75736c049e1 P b216f2e6fec64e6dbf5a84fa75e4ecfd [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:37.356513 17509 raft_consensus.cc:1261] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Refusing update from remote peer 299dc79353a644eca57ebf98c3af75a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:37.356837 17936 consensus_queue.cc:1035] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b216f2e6fec64e6dbf5a84fa75e4ecfd" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:37.356995 17995 consensus_queue.cc:1035] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2292be6911245f8b81ec71b4f2a4162" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:40:37.369837 17913 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 15:40:38.929522 17061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:38.929721 17061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:38.932183 17061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1097312640944e91bf8ffe6f21f3b882: Sending DeleteTablet for 3 replicas of tablet 6fb7b2e7307a46959c61f75736c049e1
I20260809 15:40:38.932780 17269 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:38 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43164
I20260809 15:40:38.932777 17479 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:38 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:33738
I20260809 15:40:38.932813 17683 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fb7b2e7307a46959c61f75736c049e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:38 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:42448
I20260809 15:40:38.933139 18041 tablet_replica.cc:330] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: stopping tablet replica
I20260809 15:40:38.933194 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 17174
I20260809 15:40:38.937075 18041 raft_consensus.cc:2229] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:38.937233 18041 raft_consensus.cc:2258] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:38.938006 18041 ts_tablet_manager.cc:1905] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:38.938103 18042 tablet_replica.cc:330] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: stopping tablet replica
I20260809 15:40:38.938257 18042 raft_consensus.cc:2229] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:38.938475 18042 raft_consensus.cc:2258] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:38.939174 18042 ts_tablet_manager.cc:1905] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:38.941012 18041 ts_tablet_manager.cc:1918] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:40:38.941104 18041 log.cc:1196] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/6fb7b2e7307a46959c61f75736c049e1
I20260809 15:40:38.941380 18041 ts_tablet_manager.cc:1939] T 6fb7b2e7307a46959c61f75736c049e1 P b2292be6911245f8b81ec71b4f2a4162: Deleting consensus metadata
I20260809 15:40:38.942145 18042 ts_tablet_manager.cc:1918] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:40:38.942257 18042 log.cc:1196] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/6fb7b2e7307a46959c61f75736c049e1
I20260809 15:40:38.942201 17042 catalog_manager.cc:4841] TS b2292be6911245f8b81ec71b4f2a4162 (127.14.15.130:41305): tablet 6fb7b2e7307a46959c61f75736c049e1 (table test-table [id=7a2f439a6e4c4a1d9033580d2013fc37]) successfully deleted
I20260809 15:40:38.942543 18042 ts_tablet_manager.cc:1939] T 6fb7b2e7307a46959c61f75736c049e1 P 299dc79353a644eca57ebf98c3af75a7: Deleting consensus metadata
I20260809 15:40:38.943189 17040 catalog_manager.cc:4841] TS 299dc79353a644eca57ebf98c3af75a7 (127.14.15.131:40191): tablet 6fb7b2e7307a46959c61f75736c049e1 (table test-table [id=7a2f439a6e4c4a1d9033580d2013fc37]) successfully deleted
W20260809 15:40:38.944785 17040 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:34507 (error 108)
I20260809 15:40:38.944907 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 17382
I20260809 15:40:38.954039 18048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:38.952073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34507 (local address 127.0.0.1:56380)
0809 15:40:38.953858 (+ 1785us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:38.953940 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1706,"thread_start_us":490,"threads_started":1}
W20260809 15:40:38.954308 17040 catalog_manager.cc:4584] TS b216f2e6fec64e6dbf5a84fa75e4ecfd (127.14.15.129:34507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6fb7b2e7307a46959c61f75736c049e1: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34507: connect: Connection refused (error 111)
I20260809 15:40:38.961045 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 17586
I20260809 15:40:38.979434 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 17013
2026-08-09T15:40:38Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7078 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:39 dist-test-slave-jztv krb5kdc[18051](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:39 dist-test-slave-jztv krb5kdc[18051](info): set up 2 sockets
Aug 09 15:40:39 dist-test-slave-jztv krb5kdc[18051](info): commencing operation
krb5kdc: starting...
W20260809 15:40:40.218053 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:40.349975 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:38071
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:38071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:40.464929 18070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:40.465215 18070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:40.465258 18070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:40.469321 18070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:40.469393 18070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:40.469413 18070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:40.469430 18070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:40.469445 18070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:40.475289 18070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:38071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:40.476476 18070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:40.477593 18070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:40.487015 18077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:40.487191 18070 server_base.cc:1034] running on GCE node
W20260809 15:40:40.487599 18076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:40.487684 18079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:40.488330 18070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:40.489531 18070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:40.490731 18070 hybrid_clock.cc:648] HybridClock initialized: now 1786290040490718 us; error 31 us; skew 500 ppm
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:40.493629 18070 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:40.494637 18070 webserver.cc:460] Webserver started at http://127.14.15.190:35633/ using document root <none> and password file <none>
I20260809 15:40:40.495237 18070 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:40.495335 18070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:40.495590 18070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:40.497764 18070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "632fdcbd024a428cae92f9ec0c338351"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "b78724686598b3aa6ed1983df1c53906"
server_key_iv: "d120a658bd885d2b206814452667f00c"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.498415 18070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "632fdcbd024a428cae92f9ec0c338351"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "b78724686598b3aa6ed1983df1c53906"
server_key_iv: "d120a658bd885d2b206814452667f00c"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.502331 18070 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:40.504846 18089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:40.506188 18070 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:40.506431 18070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "632fdcbd024a428cae92f9ec0c338351"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "b78724686598b3aa6ed1983df1c53906"
server_key_iv: "d120a658bd885d2b206814452667f00c"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.506588 18070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:40.523195 18070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:40.526324 18070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:40.526548 18070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:40.534401 18070 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:38071
I20260809 15:40:40.534448 18162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:38071 every 8 connection(s)
I20260809 15:40:40.535429 18070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:40.537184 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 18070
I20260809 15:40:40.537318 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:40.537621 14398 external_mini_cluster.cc:1428] Setting key 9dad0e424fb2998044fbb217dbef132c
I20260809 15:40:40.538483 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:40.545509 18163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351: Bootstrap starting.
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:40.548187 18163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:40.549161 18163 log.cc:824] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:40.551636 18163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351: No bootstrap required, opened a new log
I20260809 15:40:40.553822 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:40.539021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58794 (local address 127.14.15.190:38071)
0809 15:40:40.539459 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:40.539478 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:40.539522 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:40:40.540399 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:40.540423 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:40.540840 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:40.541233 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:40.541993 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.543553 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.544503 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.545180 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.545342 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:40.548215 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:40.548222 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:40.548239 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:40.548275 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:40.550208 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:40.550698 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:40.550704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:40.550710 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:40.550872 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:40.551172 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:40.551175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:40.551177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:40.551702 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:40.551943 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:40.552210 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 15:40:40.552512 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":121,"threads_started":1}
I20260809 15:40:40.555646 18163 raft_consensus.cc:348] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } }
I20260809 15:40:40.555898 18163 raft_consensus.cc:374] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:40.555994 18163 raft_consensus.cc:729] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632fdcbd024a428cae92f9ec0c338351, State: Initialized, Role: FOLLOWER
I20260809 15:40:40.556466 18163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } }
I20260809 15:40:40.556602 18163 raft_consensus.cc:388] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:40.556689 18163 raft_consensus.cc:482] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:40.556782 18163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:40.557708 18163 raft_consensus.cc:504] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } }
I20260809 15:40:40.558059 18163 leader_election.cc:302] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 632fdcbd024a428cae92f9ec0c338351; no voters:
I20260809 15:40:40.558400 18163 leader_election.cc:288] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:40.558552 18171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:40.558809 18171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [term 1 LEADER]: Becoming Leader. State: Replica: 632fdcbd024a428cae92f9ec0c338351, State: Running, Role: LEADER
I20260809 15:40:40.559131 18171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } }
I20260809 15:40:40.559715 18163 sys_catalog.cc:564] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:40.560811 18177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 632fdcbd024a428cae92f9ec0c338351. Latest consensus state: current_term: 1 leader_uuid: "632fdcbd024a428cae92f9ec0c338351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } } }
I20260809 15:40:40.560952 18177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:40.561249 18176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "632fdcbd024a428cae92f9ec0c338351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632fdcbd024a428cae92f9ec0c338351" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 38071 } } }
I20260809 15:40:40.561343 18176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:40.561443 18189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:40.564244 18189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:40.569705 18189 catalog_manager.cc:1347] Generated new cluster ID: 40c3bee74ef34dafb0167f1bb52eb75d
I20260809 15:40:40.569772 18189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:40.575716 18189 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:40.576558 18189 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:40.582989 18189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 632fdcbd024a428cae92f9ec0c338351: Generated new TSK 0
I20260809 15:40:40.583634 18189 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:40.616794 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:40.732702 18208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:40.733019 18208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:40.733062 18208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:40.737015 18208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:40.737067 18208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:40.737160 18208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:40.743470 18208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:40.744503 18208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:40.745519 18208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:40:40.755005 18208 server_base.cc:1034] running on GCE node
W20260809 15:40:40.754906 18220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:40.754902 18222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:40.754890 18219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:40.755558 18208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:40.756181 18208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:40.757326 18208 hybrid_clock.cc:648] HybridClock initialized: now 1786290040757310 us; error 30 us; skew 500 ppm
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:40.760076 18208 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:40.761015 18208 webserver.cc:460] Webserver started at http://127.14.15.129:34389/ using document root <none> and password file <none>
I20260809 15:40:40.761674 18208 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:40.761741 18208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:40.761977 18208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:40.764045 18208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "fad9683838674f81aba0ce3ab72be130"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "465f6113919b44058a4c4366203e2093"
server_key_iv: "15c6793d05a244f0b0abadaf95f4d8a4"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.764607 18208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "fad9683838674f81aba0ce3ab72be130"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "465f6113919b44058a4c4366203e2093"
server_key_iv: "15c6793d05a244f0b0abadaf95f4d8a4"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.768323 18208 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:40:40.770721 18235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:40.771831 18208 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:40.771979 18208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "fad9683838674f81aba0ce3ab72be130"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "465f6113919b44058a4c4366203e2093"
server_key_iv: "15c6793d05a244f0b0abadaf95f4d8a4"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.772091 18208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:40.791972 18208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:40.794802 18208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:40.795010 18208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:40.795583 18208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:40.796398 18208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:40.796478 18208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:40.796551 18208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:40.796594 18208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:40.805795 18208 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:33341
I20260809 15:40:40.805815 18399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:33341 every 8 connection(s)
I20260809 15:40:40.806679 18208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:40.814183 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 18208
I20260809 15:40:40.814368 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:40.814656 14398 external_mini_cluster.cc:1428] Setting key 6c754b39bbb16e2fa066694c0a140ab9
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:40.821105 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:40.808456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:59739 (local address 127.14.15.190:38071)
0809 15:40:40.808588 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:40.808592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:40.809403 (+ 811us) server_negotiation.cc:407] Connection header received
0809 15:40:40.810862 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:40.810866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:40.810956 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:40.811076 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:40.812199 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.812742 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.813862 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.814117 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.814252 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:40.816886 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:40.816890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:40.816893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:40.816926 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:40.818625 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:40.819162 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:40.819168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:40.819172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:40.819275 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:40.819688 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:40.819693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:40.819696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:40.819946 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:40.820031 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:40.820684 (+ 653us) server_negotiation.cc:299] Negotiation successful
0809 15:40:40.820839 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:40:40.821856 18405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:40.808795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:38071 (local address 127.14.15.129:59739)
0809 15:40:40.809238 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:40.809280 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:40.810652 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:40.811240 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:40.811247 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:40.811591 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:40.812053 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:40.812066 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.812872 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.812881 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:40.813726 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:40.813735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:40.814296 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:40.814300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:40.814511 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:40.815111 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:40.815126 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:40.816721 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:40.818765 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:40.818770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:40.818782 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:40.819057 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:40.819420 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:40.819423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:40.819425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:40.819582 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:40.820081 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:40.820087 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:40.820420 (+ 333us) client_negotiation.cc:769] Sending connection context
0809 15:40:40.820603 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 15:40:40.820868 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":125,"threads_started":1}
I20260809 15:40:40.823302 18400 heartbeater.cc:347] Connected to a master server at 127.14.15.190:38071
I20260809 15:40:40.823612 18400 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:40.824294 18400 heartbeater.cc:511] Master 127.14.15.190:38071 requested a full tablet report, sending...
I20260809 15:40:40.825929 18114 ts_manager.cc:194] Registered new tserver with Master: fad9683838674f81aba0ce3ab72be130 (127.14.15.129:33341)
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:40.827203 18114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:59739
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:40.845551 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:40.963068 18411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:40.963321 18411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:40.963363 18411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:40.967301 18411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:40.967360 18411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:40.967422 18411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:40.972555 18411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:40.973577 18411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:40.974583 18411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:40.984694 18418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:40.984575 18420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:40.984575 18416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:40.984918 18411 server_base.cc:1034] running on GCE node
I20260809 15:40:40.985491 18411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:40.986184 18411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:40.987457 18411 hybrid_clock.cc:648] HybridClock initialized: now 1786290040987440 us; error 27 us; skew 500 ppm
Aug 09 15:40:40 dist-test-slave-jztv krb5kdc[18051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:40.990506 18411 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:40.991432 18411 webserver.cc:460] Webserver started at http://127.14.15.130:38531/ using document root <none> and password file <none>
I20260809 15:40:40.992028 18411 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:40.992141 18411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:40.992343 18411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:40.994546 18411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "720626a3710e46489b09c60573ccd245"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "e6848ab84912ebb5c0a83e0395aaea9f"
server_key_iv: "c99eeafd92178ea6408fd7e58465ccc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.995090 18411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "720626a3710e46489b09c60573ccd245"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "e6848ab84912ebb5c0a83e0395aaea9f"
server_key_iv: "c99eeafd92178ea6408fd7e58465ccc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:40.998858 18411 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:41.001294 18431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.002637 18411 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:41.002749 18411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "720626a3710e46489b09c60573ccd245"
format_stamp: "Formatted at 2026-08-09 15:40:40 on dist-test-slave-jztv"
server_key: "e6848ab84912ebb5c0a83e0395aaea9f"
server_key_iv: "c99eeafd92178ea6408fd7e58465ccc9"
server_key_version: "encryptionkey@0"
I20260809 15:40:41.002839 18411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:41.023357 18411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:41.026362 18411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:41.026546 18411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:41.027091 18411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:41.027906 18411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:41.027956 18411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.027995 18411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:41.028014 18411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.037081 18411 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:45863
I20260809 15:40:41.037117 18604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:45863 every 8 connection(s)
I20260809 15:40:41.037986 18411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:41.043165 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 18411
I20260809 15:40:41.043285 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:41.043607 14398 external_mini_cluster.cc:1428] Setting key ccaea0926338c19fea821429bf80c0b5
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290040, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:41.053588 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:41.039836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:49513 (local address 127.14.15.190:38071)
0809 15:40:41.039996 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:41.040000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:41.040879 (+ 879us) server_negotiation.cc:407] Connection header received
0809 15:40:41.042126 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:41.042129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:41.042178 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:41.042307 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:41.043700 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.044363 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.045877 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.046095 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.046178 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:41.049419 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:41.049422 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:41.049424 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:41.049448 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:41.051127 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:41.051795 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:41.051798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:41.051799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:41.051887 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:41.052321 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:41.052324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:41.052325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:41.052582 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:41.052705 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:41.053348 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 15:40:41.053458 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:40:41.054860 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:41.040266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:38071 (local address 127.14.15.130:49513)
0809 15:40:41.040718 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:41.040761 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:41.041928 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:41.042449 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:41.042456 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:41.042799 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:41.043522 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:41.043545 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.044497 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.044501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:41.045743 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:41.045758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.046283 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.046291 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:41.046544 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:41.047196 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:41.047223 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:41.049223 (+ 2000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:41.051258 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:41.051267 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:41.051286 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:41.051690 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:41.051986 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:41.051992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:41.051997 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:41.052210 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:41.052720 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:41.052729 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:41.053077 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 15:40:41.053304 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 15:40:41.053690 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:40:41.056188 18605 heartbeater.cc:347] Connected to a master server at 127.14.15.190:38071
I20260809 15:40:41.056479 18605 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:41.056983 18605 heartbeater.cc:511] Master 127.14.15.190:38071 requested a full tablet report, sending...
I20260809 15:40:41.058171 18114 ts_manager.cc:194] Registered new tserver with Master: 720626a3710e46489b09c60573ccd245 (127.14.15.130:45863)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:41.058940 18114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:49513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:41.076880 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:41.190739 18610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:41.190994 18610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:41.191036 18610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:41.195241 18610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:41.195298 18610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:41.195385 18610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:41.200632 18610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:38071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:41.201675 18610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:41.202765 18610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:41.213008 18616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:41.213030 18622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:41.213034 18617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:41.213102 18610 server_base.cc:1034] running on GCE node
I20260809 15:40:41.213780 18610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:41.214489 18610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:41.215693 18610 hybrid_clock.cc:648] HybridClock initialized: now 1786290041215673 us; error 31 us; skew 500 ppm
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:41.218447 18610 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:41.219388 18610 webserver.cc:460] Webserver started at http://127.14.15.131:38465/ using document root <none> and password file <none>
I20260809 15:40:41.219973 18610 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:41.220067 18610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:41.220297 18610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:41.222527 18610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "d41b82eeb8b0402ca339535f53da38d2"
format_stamp: "Formatted at 2026-08-09 15:40:41 on dist-test-slave-jztv"
server_key: "ccb9ca3b44498606a39a23f29768aec5"
server_key_iv: "148cbbf7442c0a01353a0e14c285e335"
server_key_version: "encryptionkey@0"
I20260809 15:40:41.223124 18610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "d41b82eeb8b0402ca339535f53da38d2"
format_stamp: "Formatted at 2026-08-09 15:40:41 on dist-test-slave-jztv"
server_key: "ccb9ca3b44498606a39a23f29768aec5"
server_key_iv: "148cbbf7442c0a01353a0e14c285e335"
server_key_version: "encryptionkey@0"
I20260809 15:40:41.227015 18610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:41.229466 18630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.230741 18610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:41.230882 18610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "d41b82eeb8b0402ca339535f53da38d2"
format_stamp: "Formatted at 2026-08-09 15:40:41 on dist-test-slave-jztv"
server_key: "ccb9ca3b44498606a39a23f29768aec5"
server_key_iv: "148cbbf7442c0a01353a0e14c285e335"
server_key_version: "encryptionkey@0"
I20260809 15:40:41.230999 18610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:41.248890 18610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:41.252100 18610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:41.252315 18610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:41.252944 18610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:41.253806 18610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:41.253880 18610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.253954 18610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:41.254006 18610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:41.264245 18610 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:44069
I20260809 15:40:41.264266 18807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:44069 every 8 connection(s)
I20260809 15:40:41.265156 18610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:41.274575 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 18610
I20260809 15:40:41.274713 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290041, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:41.275058 14398 external_mini_cluster.cc:1428] Setting key e693e0116e63ac2c89b009d8bd4284ef
I20260809 15:40:41.279701 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:41.267076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:50145 (local address 127.14.15.190:38071)
0809 15:40:41.267264 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:41.267270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:41.268153 (+ 883us) server_negotiation.cc:407] Connection header received
0809 15:40:41.269493 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:41.269496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:41.269550 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:41.269654 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:41.270835 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.271377 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.272468 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.272683 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.272760 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:41.275688 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:41.275691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:41.275693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:41.275718 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:41.277408 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:41.277931 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:41.277937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:41.277941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:41.278029 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:41.278453 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:41.278457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:41.278459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:41.278651 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:41.278764 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:41.279397 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 15:40:41.279532 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 15:40:41.280509 18812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:41.267508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:38071 (local address 127.14.15.131:50145)
0809 15:40:41.267994 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:41.268037 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:41.269264 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:41.269835 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:41.269842 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:41.270190 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:41.270694 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:41.270707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.271505 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.271507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:41.272360 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:41.272369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:41.272817 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:41.272819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:41.272970 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:41.273607 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:41.273624 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:41.275434 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:41.277533 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:41.277540 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:41.277554 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:41.277823 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:41.278132 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:41.278135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:41.278137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:41.278347 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:41.278763 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:41.278771 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:41.279131 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 15:40:41.279321 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 15:40:41.279658 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":124,"threads_started":1}
I20260809 15:40:41.281597 18808 heartbeater.cc:347] Connected to a master server at 127.14.15.190:38071
I20260809 15:40:41.281845 18808 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:41.282444 18808 heartbeater.cc:511] Master 127.14.15.190:38071 requested a full tablet report, sending...
I20260809 15:40:41.283522 18114 ts_manager.cc:194] Registered new tserver with Master: d41b82eeb8b0402ca339535f53da38d2 (127.14.15.131:44069)
I20260809 15:40:41.284111 18114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:50145
I20260809 15:40:41.289080 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:40:41.304390 18169 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:41.302922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.14.15.190:38071)
0809 15:40:41.303105 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:41.303112 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:41.303220 (+ 108us) server_negotiation.cc:407] Connection header received
0809 15:40:41.303337 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:41.303339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:41.303388 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:41.303469 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:41.304239 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58796: BlockingRecv error: recv got EOF from 127.0.0.1:58796 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:40:41.305450 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 18208
I20260809 15:40:41.322908 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 18411
I20260809 15:40:41.334878 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 18610
I20260809 15:40:41.343389 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 18070
2026-08-09T15:40:41Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2363 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18827](info): set up 2 sockets
Aug 09 15:40:41 dist-test-slave-jztv krb5kdc[18827](info): commencing operation
krb5kdc: starting...
W20260809 15:40:42.614125 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:42 dist-test-slave-jztv krb5kdc[18827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:42.749931 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44023
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:44023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:42.864167 18844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:42.864439 18844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:42.864487 18844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:42.868703 18844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:42.868758 18844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:42.868777 18844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:42.868794 18844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:42.868839 18844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:42.873994 18844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:44023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:42.875083 18844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:42.876112 18844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:42.884979 18853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:42.885016 18854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:42.885023 18856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:42.885319 18844 server_base.cc:1034] running on GCE node
I20260809 15:40:42.886140 18844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:42.887445 18844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:42.888651 18844 hybrid_clock.cc:648] HybridClock initialized: now 1786290042888635 us; error 35 us; skew 500 ppm
Aug 09 15:40:42 dist-test-slave-jztv krb5kdc[18827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290042, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:42.891584 18844 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:42.892599 18844 webserver.cc:460] Webserver started at http://127.14.15.190:46099/ using document root <none> and password file <none>
I20260809 15:40:42.893190 18844 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:42.893288 18844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:42.893548 18844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:42.895757 18844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "a511d3947ca74d3fa4f57aea9390c217"
format_stamp: "Formatted at 2026-08-09 15:40:42 on dist-test-slave-jztv"
server_key: "72edd8d329e908657ff889ed4a7b4099"
server_key_iv: "24d6f1d3d3b220e01e52b50723b25918"
server_key_version: "encryptionkey@0"
I20260809 15:40:42.896358 18844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "a511d3947ca74d3fa4f57aea9390c217"
format_stamp: "Formatted at 2026-08-09 15:40:42 on dist-test-slave-jztv"
server_key: "72edd8d329e908657ff889ed4a7b4099"
server_key_iv: "24d6f1d3d3b220e01e52b50723b25918"
server_key_version: "encryptionkey@0"
I20260809 15:40:42.900380 18844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:42.903033 18863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:42.904228 18844 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:42.904395 18844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "a511d3947ca74d3fa4f57aea9390c217"
format_stamp: "Formatted at 2026-08-09 15:40:42 on dist-test-slave-jztv"
server_key: "72edd8d329e908657ff889ed4a7b4099"
server_key_iv: "24d6f1d3d3b220e01e52b50723b25918"
server_key_version: "encryptionkey@0"
I20260809 15:40:42.904520 18844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:42.915014 18844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:42.917922 18844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:42.918134 18844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:42.925179 18844 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:44023
I20260809 15:40:42.925482 18946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:44023 every 8 connection(s)
I20260809 15:40:42.926277 18844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:42.927470 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 18844
I20260809 15:40:42.927613 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:42.927891 14398 external_mini_cluster.cc:1428] Setting key 58c7f2f903c3224f55d2a3c760516ab3
I20260809 15:40:42.929441 18948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:42.936106 18948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217: Bootstrap starting.
Aug 09 15:40:42 dist-test-slave-jztv krb5kdc[18827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:42.938570 18948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:42.939308 18948 log.cc:824] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:42.941622 18948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217: No bootstrap required, opened a new log
I20260809 15:40:42.943284 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:42.929278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37070 (local address 127.14.15.190:44023)
0809 15:40:42.929736 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:42.929758 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:42.929794 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:42.930528 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:42.930548 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:42.930875 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:42.931158 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:42.932130 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:42.933112 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:42.934328 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:42.934826 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:42.934981 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:42.937831 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:42.937837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:42.937849 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:42.937890 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:42.939947 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:42.940473 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:42.940478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:42.940483 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:42.940599 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:42.940936 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:42.940939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:42.940941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:42.941366 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:42.941534 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:42.941909 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 15:40:42.942317 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":176,"threads_started":1}
I20260809 15:40:42.945045 18948 raft_consensus.cc:348] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } }
I20260809 15:40:42.945312 18948 raft_consensus.cc:374] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:42.945405 18948 raft_consensus.cc:729] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a511d3947ca74d3fa4f57aea9390c217, State: Initialized, Role: FOLLOWER
I20260809 15:40:42.945889 18948 consensus_queue.cc:260] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } }
I20260809 15:40:42.946053 18948 raft_consensus.cc:388] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:42.946121 18948 raft_consensus.cc:482] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:42.946252 18948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:42.946398 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:40:42.947227 18948 raft_consensus.cc:504] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } }
I20260809 15:40:42.947575 18948 leader_election.cc:302] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a511d3947ca74d3fa4f57aea9390c217; no voters:
I20260809 15:40:42.947909 18948 leader_election.cc:288] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:42.947999 18957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:42.948217 18957 raft_consensus.cc:686] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [term 1 LEADER]: Becoming Leader. State: Replica: a511d3947ca74d3fa4f57aea9390c217, State: Running, Role: LEADER
I20260809 15:40:42.948582 18957 consensus_queue.cc:237] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } }
I20260809 15:40:42.949222 18948 sys_catalog.cc:564] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:42.949852 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a511d3947ca74d3fa4f57aea9390c217. Latest consensus state: current_term: 1 leader_uuid: "a511d3947ca74d3fa4f57aea9390c217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } } }
I20260809 15:40:42.950083 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:42.950295 18958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a511d3947ca74d3fa4f57aea9390c217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a511d3947ca74d3fa4f57aea9390c217" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44023 } } }
I20260809 15:40:42.950400 18958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:42.950577 18968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:42.953974 18968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:42.960057 18968 catalog_manager.cc:1347] Generated new cluster ID: 106bad10d712466abf0c223c85e9de53
I20260809 15:40:42.960134 18968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:42.966316 18968 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:42.967540 18968 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:42.974011 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:42.968915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37080 (local address 127.14.15.190:44023)
0809 15:40:42.969058 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:42.969063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:42.969356 (+ 293us) server_negotiation.cc:407] Connection header received
0809 15:40:42.969546 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:42.969549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:42.969601 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:42.969686 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:42.970263 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:42.970809 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:42.971805 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:42.972052 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:42.972163 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:42.973064 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:42.973068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:42.973071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:42.973525 (+ 454us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:42.973556 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:42.973574 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:42.973682 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:42.973795 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 15:40:42.973862 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:40:42.987552 18968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a511d3947ca74d3fa4f57aea9390c217: Generated new TSK 0
I20260809 15:40:42.988271 18968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:40:42.997179 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 18844
2026-08-09T15:40:43Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1651 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:43 dist-test-slave-jztv krb5kdc[18993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:43 dist-test-slave-jztv krb5kdc[18993](info): set up 2 sockets
Aug 09 15:40:43 dist-test-slave-jztv krb5kdc[18993](info): commencing operation
krb5kdc: starting...
W20260809 15:40:44.226393 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:44 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:44.366837 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44425
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:44425
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:44.485285 19013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:44.485565 19013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:44.485612 19013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:44.489709 19013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:44.489782 19013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:44.489801 19013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:44.489818 19013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:44.489835 19013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:44.495317 19013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:44425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:44.496441 19013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:44.497488 19013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:44.506531 19023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:44.506515 19022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:44.506493 19027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:44.506683 19013 server_base.cc:1034] running on GCE node
I20260809 15:40:44.507493 19013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:44.508641 19013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:44.509841 19013 hybrid_clock.cc:648] HybridClock initialized: now 1786290044509826 us; error 27 us; skew 500 ppm
Aug 09 15:40:44 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290044, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:44.516613 19013 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:44.517536 19013 webserver.cc:460] Webserver started at http://127.14.15.190:43839/ using document root <none> and password file <none>
I20260809 15:40:44.518080 19013 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:44.518141 19013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:44.518393 19013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:44.520462 19013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "b3564349c842452b9df4005d04931d3b"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "e6fdb14003d124e336a4d7d2a4835ba7"
server_key_iv: "fc34fcf80434c6e05cd14e636e3700b9"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.520995 19013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "b3564349c842452b9df4005d04931d3b"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "e6fdb14003d124e336a4d7d2a4835ba7"
server_key_iv: "fc34fcf80434c6e05cd14e636e3700b9"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.524948 19013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:44.527496 19036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:44.528872 19013 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:44.529027 19013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "b3564349c842452b9df4005d04931d3b"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "e6fdb14003d124e336a4d7d2a4835ba7"
server_key_iv: "fc34fcf80434c6e05cd14e636e3700b9"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.529152 19013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:44.541970 19013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:44.545341 19013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:44.545559 19013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:44.552547 19013 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:44425
I20260809 15:40:44.552865 19104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:44425 every 8 connection(s)
I20260809 15:40:44.553570 19013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:44.554788 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19013
I20260809 15:40:44.554935 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:44.555222 14398 external_mini_cluster.cc:1428] Setting key ccd79b6a29fb0ec91c8efdf88ea9718d
I20260809 15:40:44.556777 19105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:44.563400 19105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b: Bootstrap starting.
Aug 09 15:40:44 dist-test-slave-jztv krb5kdc[18993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:44.566071 19105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:44.566999 19105 log.cc:824] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:44.569375 19105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b: No bootstrap required, opened a new log
I20260809 15:40:44.570153 19111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:44.556570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.14.15.190:44425)
0809 15:40:44.556982 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:44.556999 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:44.557034 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:40:44.557674 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:44.557691 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:44.558004 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:44.558342 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:44.559236 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.560253 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.561467 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.561931 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.562059 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:44.564876 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:44.564882 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:44.564897 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:44.564930 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:44.566938 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:44.567430 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:44.567437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:44.567444 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:44.567568 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:44.567901 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:44.567904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:44.567905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:44.568401 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:44.568620 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:44.568901 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 15:40:44.569200 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":142,"threads_started":1}
I20260809 15:40:44.573415 19105 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } }
I20260809 15:40:44.573638 19105 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:44.573673 19105 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3564349c842452b9df4005d04931d3b, State: Initialized, Role: FOLLOWER
I20260809 15:40:44.574076 19105 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } }
I20260809 15:40:44.574198 19105 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:44.574301 19105 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:44.574379 19105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:44.575405 19105 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } }
I20260809 15:40:44.575755 19105 leader_election.cc:302] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3564349c842452b9df4005d04931d3b; no voters:
I20260809 15:40:44.576061 19105 leader_election.cc:288] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:44.576191 19113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:44.576442 19113 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [term 1 LEADER]: Becoming Leader. State: Replica: b3564349c842452b9df4005d04931d3b, State: Running, Role: LEADER
I20260809 15:40:44.576807 19113 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } }
I20260809 15:40:44.577222 19105 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:44.578496 19116 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3564349c842452b9df4005d04931d3b. Latest consensus state: current_term: 1 leader_uuid: "b3564349c842452b9df4005d04931d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } } }
I20260809 15:40:44.578642 19116 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:44.578974 19115 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3564349c842452b9df4005d04931d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3564349c842452b9df4005d04931d3b" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44425 } } }
I20260809 15:40:44.579061 19115 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:44.579430 19126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:44.582443 19126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:44.587548 19126 catalog_manager.cc:1347] Generated new cluster ID: 76c33f7f21af460a87560c515b36059b
I20260809 15:40:44.587617 19126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:44.601500 19126 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:44.602676 19126 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:44.608156 19126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3564349c842452b9df4005d04931d3b: Generated new TSK 0
I20260809 15:40:44.608898 19126 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:44.643159 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:44.760779 19142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:44.761046 19142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:44.761089 19142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:44.765198 19142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:44.765256 19142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:44.765347 19142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:44.770815 19142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:44.771878 19142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:44.772894 19142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:44.782971 19157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:44.783011 19142 server_base.cc:1034] running on GCE node
W20260809 15:40:44.782974 19152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:44.783016 19153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:44.783679 19142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:44.784271 19142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:44.785482 19142 hybrid_clock.cc:648] HybridClock initialized: now 1786290044785463 us; error 32 us; skew 500 ppm
Aug 09 15:40:44 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290044, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:44.788470 19142 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:44.789374 19142 webserver.cc:460] Webserver started at http://127.14.15.129:34979/ using document root <none> and password file <none>
I20260809 15:40:44.789988 19142 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:44.790091 19142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:44.790393 19142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:44.792516 19142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "ea5cdd334393414aa436f0d64cfd92c5"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "b110c6ba86c338bd8e42576378a24fc3"
server_key_iv: "b0ee1cd3d3fbc385b3c57937445b40c0"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.793108 19142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "ea5cdd334393414aa436f0d64cfd92c5"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "b110c6ba86c338bd8e42576378a24fc3"
server_key_iv: "b0ee1cd3d3fbc385b3c57937445b40c0"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.797150 19142 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:44.799950 19165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:44.801334 19142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:40:44.801522 19142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "ea5cdd334393414aa436f0d64cfd92c5"
format_stamp: "Formatted at 2026-08-09 15:40:44 on dist-test-slave-jztv"
server_key: "b110c6ba86c338bd8e42576378a24fc3"
server_key_iv: "b0ee1cd3d3fbc385b3c57937445b40c0"
server_key_version: "encryptionkey@0"
I20260809 15:40:44.801654 19142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:44.813284 19142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:44.816679 19142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:44.816915 19142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:44.817567 19142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:44.818537 19142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:44.818624 19142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:44.818701 19142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:44.818744 19142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:44.828667 19142 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:38935
I20260809 15:40:44.828686 19329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:38935 every 8 connection(s)
I20260809 15:40:44.829671 19142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:44.830857 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19142
I20260809 15:40:44.831053 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:44.831413 14398 external_mini_cluster.cc:1428] Setting key 9b3aec90ace91297a4687d49528865e9
Aug 09 15:40:44 dist-test-slave-jztv krb5kdc[18993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290044, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:44.845549 19111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:44.832051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41647 (local address 127.14.15.190:44425)
0809 15:40:44.832196 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:44.832201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:44.833443 (+ 1242us) server_negotiation.cc:407] Connection header received
0809 15:40:44.834998 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:44.835001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:44.835060 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:44.835149 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:44.836598 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.837152 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.838500 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.838749 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.838865 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:44.841564 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:44.841568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:44.841570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:44.841598 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:44.843191 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:44.843752 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:44.843756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:44.843758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:44.843856 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:44.844269 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:44.844272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:44.844274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:44.844485 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:44.844600 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:44.845218 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 15:40:44.845358 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:40:44.846463 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:44.832521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44425 (local address 127.14.15.129:41647)
0809 15:40:44.833287 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:44.833331 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:44.834776 (+ 1445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:44.835328 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:44.835335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:44.835832 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:44.836404 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:44.836420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.837291 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.837296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:44.838353 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:44.838365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:44.838912 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:44.838916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:44.839104 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:44.839827 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:44.839845 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:44.841371 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:44.843336 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:44.843342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:44.843358 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:44.843636 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:44.843961 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:44.843965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:44.843967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:44.844175 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:44.844600 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:44.844608 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:44.844927 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 15:40:44.845176 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 15:40:44.845521 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":160,"threads_started":1}
I20260809 15:40:44.847779 19330 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44425
I20260809 15:40:44.848048 19330 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:44.848587 19330 heartbeater.cc:511] Master 127.14.15.190:44425 requested a full tablet report, sending...
I20260809 15:40:44.850206 19056 ts_manager.cc:194] Registered new tserver with Master: ea5cdd334393414aa436f0d64cfd92c5 (127.14.15.129:38935)
I20260809 15:40:44.851438 19056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:41647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:44.862066 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:44.980235 19338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:44.980495 19338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:44.980540 19338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:44.984661 19338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:44.984731 19338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:44.984817 19338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:44.990330 19338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:44.991469 19338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:44.992525 19338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:45.002480 19349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:45.002490 19345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:45.002538 19344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:45.002724 19338 server_base.cc:1034] running on GCE node
I20260809 15:40:45.003162 19338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:45.003780 19338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:45.004980 19338 hybrid_clock.cc:648] HybridClock initialized: now 1786290045004960 us; error 30 us; skew 500 ppm
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:45.008013 19338 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:45.008898 19338 webserver.cc:460] Webserver started at http://127.14.15.130:33813/ using document root <none> and password file <none>
I20260809 15:40:45.009479 19338 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:45.009543 19338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:45.009722 19338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:45.011869 19338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "f067b9c29d6c417eb85ff22d55753da6"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "72964eb4bc4f9f51890bec49c5c01224"
server_key_iv: "6bd04460b2935ef3248275e8bd8101d2"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.012426 19338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "f067b9c29d6c417eb85ff22d55753da6"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "72964eb4bc4f9f51890bec49c5c01224"
server_key_iv: "6bd04460b2935ef3248275e8bd8101d2"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.016324 19338 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 15:40:45.019109 19360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.020591 19338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:45.020701 19338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "f067b9c29d6c417eb85ff22d55753da6"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "72964eb4bc4f9f51890bec49c5c01224"
server_key_iv: "6bd04460b2935ef3248275e8bd8101d2"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.020874 19338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:45.033802 19338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:45.037248 19338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:45.037426 19338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:45.038002 19338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:45.038932 19338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:45.038990 19338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.039032 19338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:45.039048 19338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.048309 19338 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:41957
I20260809 15:40:45.048334 19522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:41957 every 8 connection(s)
I20260809 15:40:45.049268 19338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:45.050040 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19338
I20260809 15:40:45.050171 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:45.050575 14398 external_mini_cluster.cc:1428] Setting key 58bc649e9665b57ba321c663efea380e
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:45.064571 19111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:45.051380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:57927 (local address 127.14.15.190:44425)
0809 15:40:45.051537 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:45.051542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:45.052651 (+ 1109us) server_negotiation.cc:407] Connection header received
0809 15:40:45.054053 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:45.054057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:45.054114 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:45.054257 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:45.055479 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.056022 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.057296 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.057533 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.057649 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:45.060612 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:45.060616 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:45.060618 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:45.060645 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:45.062356 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.062936 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.062939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.062940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.063024 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.063347 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.063349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.063350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.063539 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:45.063660 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:45.064258 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 15:40:45.064396 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:40:45.065834 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:45.051911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44425 (local address 127.14.15.130:57927)
0809 15:40:45.052501 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:45.052545 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:45.053839 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:45.054449 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:45.054456 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:45.054824 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:45.055305 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:45.055318 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.056161 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.056165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:45.057165 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:45.057176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.057698 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.057702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:45.057879 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:45.058581 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:45.058604 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:45.060376 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:45.062527 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:45.062532 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:45.062547 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:45.062825 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:45.063110 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:45.063112 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:45.063114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:45.063263 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:45.063651 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:45.063656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:45.063967 (+ 311us) client_negotiation.cc:769] Sending connection context
0809 15:40:45.064171 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 15:40:45.064633 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":170,"threads_started":1}
I20260809 15:40:45.067305 19523 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44425
I20260809 15:40:45.067606 19523 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:45.068259 19523 heartbeater.cc:511] Master 127.14.15.190:44425 requested a full tablet report, sending...
I20260809 15:40:45.069409 19056 ts_manager.cc:194] Registered new tserver with Master: f067b9c29d6c417eb85ff22d55753da6 (127.14.15.130:41957)
I20260809 15:40:45.070029 19056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:57927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:45.083263 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:45.202672 19529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:45.203003 19529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:45.203117 19529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:45.207461 19529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:45.207563 19529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:45.207656 19529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:45.213290 19529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:45.214560 19529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:45.215649 19529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:45.225916 19535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:45.225944 19540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:45.225916 19537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:45.226419 19529 server_base.cc:1034] running on GCE node
I20260809 15:40:45.226908 19529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:45.227628 19529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:45.228818 19529 hybrid_clock.cc:648] HybridClock initialized: now 1786290045228783 us; error 47 us; skew 500 ppm
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:45.231974 19529 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:45.233062 19529 webserver.cc:460] Webserver started at http://127.14.15.131:32947/ using document root <none> and password file <none>
I20260809 15:40:45.233626 19529 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:45.233686 19529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:45.233902 19529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:45.236088 19529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "67ab4071ca844ea1b1e166902be27722"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "2b93c1261372d9eeaec6ac002a160ffb"
server_key_iv: "64e287ffbf7ea0ffa282b9826885b2ef"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.236685 19529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "67ab4071ca844ea1b1e166902be27722"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "2b93c1261372d9eeaec6ac002a160ffb"
server_key_iv: "64e287ffbf7ea0ffa282b9826885b2ef"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.240561 19529 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:45.243086 19550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.244295 19529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:45.244455 19529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "67ab4071ca844ea1b1e166902be27722"
format_stamp: "Formatted at 2026-08-09 15:40:45 on dist-test-slave-jztv"
server_key: "2b93c1261372d9eeaec6ac002a160ffb"
server_key_iv: "64e287ffbf7ea0ffa282b9826885b2ef"
server_key_version: "encryptionkey@0"
I20260809 15:40:45.244578 19529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:45.266179 19529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:45.269320 19529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:45.269559 19529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:45.270181 19529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:45.271088 19529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:45.271164 19529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.271242 19529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:45.271293 19529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:45.280933 19529 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:44575
I20260809 15:40:45.280975 19730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:44575 every 8 connection(s)
I20260809 15:40:45.281942 19529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:45.292021 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19529
I20260809 15:40:45.292171 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:45.292477 14398 external_mini_cluster.cc:1428] Setting key 01b9eb0c3958f3c484ec862a003c25d1
I20260809 15:40:45.296535 19111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:45.283930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:43289 (local address 127.14.15.190:44425)
0809 15:40:45.284089 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:45.284092 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:45.284920 (+ 828us) server_negotiation.cc:407] Connection header received
0809 15:40:45.286424 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:45.286427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:45.286491 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:45.286610 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:45.287831 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.288371 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.289531 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.289750 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.289866 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:45.292652 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:45.292655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:45.292657 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:45.292684 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:45.294288 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.294906 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.294913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.294931 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.295037 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.295448 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.295452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.295453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.295670 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:45.295762 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:45.296294 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 15:40:45.296409 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:40:45.297410 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:45.284307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44425 (local address 127.14.15.131:43289)
0809 15:40:45.284766 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:45.284809 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:45.286136 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:45.286801 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:45.286808 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:45.287193 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:45.287679 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:45.287692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.288500 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.288504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:45.289380 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:45.289390 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.289911 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.289915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:45.290102 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:45.290777 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:45.290795 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:45.292456 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:45.294405 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:45.294411 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:45.294427 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:45.294790 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:45.295160 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:45.295162 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:45.295164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:45.295311 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:45.295773 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:45.295778 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:45.296042 (+ 264us) client_negotiation.cc:769] Sending connection context
0809 15:40:45.296206 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 15:40:45.296480 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":109,"threads_started":1}
I20260809 15:40:45.298745 19732 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44425
I20260809 15:40:45.299005 19732 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:45.299531 19732 heartbeater.cc:511] Master 127.14.15.190:44425 requested a full tablet report, sending...
I20260809 15:40:45.300607 19056 ts_manager.cc:194] Registered new tserver with Master: 67ab4071ca844ea1b1e166902be27722 (127.14.15.131:44575)
I20260809 15:40:45.301186 19056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:43289
I20260809 15:40:45.307092 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[18993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:45.336014 19111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:45.326485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.14.15.190:44425)
0809 15:40:45.326698 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:45.326702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:45.326857 (+ 155us) server_negotiation.cc:407] Connection header received
0809 15:40:45.326970 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:45.326973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:45.327024 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:45.327113 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:45.327878 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.328458 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.329312 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:45.329526 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:45.329607 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:45.332468 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:45.332472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:45.332474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:45.332503 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:45.334190 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.334673 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.334677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.334678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.334777 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:45.335098 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:45.335100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:45.335101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:45.335361 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:45.335472 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:45.335745 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 15:40:45.335860 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
W20260809 15:40:45.336443 19056 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35178
I20260809 15:40:45.337654 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19142
I20260809 15:40:45.352407 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19338
I20260809 15:40:45.367229 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19529
I20260809 15:40:45.378399 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19013
2026-08-09T15:40:45Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2384 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[19748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[19748](info): set up 2 sockets
Aug 09 15:40:45 dist-test-slave-jztv krb5kdc[19748](info): commencing operation
krb5kdc: starting...
W20260809 15:40:46.628903 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:46 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:46.761415 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36041
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:36041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:46.875135 19765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:46.875458 19765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:46.875571 19765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:46.879602 19765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:46.879693 19765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:46.879733 19765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:46.879770 19765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:46.879806 19765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:46.884994 19765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:36041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:46.886078 19765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:46.887177 19765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:46.895809 19775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:46.895810 19771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:46.895843 19773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:46.896154 19765 server_base.cc:1034] running on GCE node
I20260809 15:40:46.896734 19765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:46.897758 19765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:46.898950 19765 hybrid_clock.cc:648] HybridClock initialized: now 1786290046898920 us; error 44 us; skew 500 ppm
Aug 09 15:40:46 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290046, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:46.901683 19765 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:46.902637 19765 webserver.cc:460] Webserver started at http://127.14.15.190:44415/ using document root <none> and password file <none>
I20260809 15:40:46.903211 19765 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:46.903308 19765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:46.903554 19765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:46.905620 19765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "cb21e57f9eae4fc2a7651e0025620ca5"
format_stamp: "Formatted at 2026-08-09 15:40:46 on dist-test-slave-jztv"
server_key: "63a07f74d89d7a4804d7958b16c26d63"
server_key_iv: "03e1f418bd34c9d1ab30fed28c702876"
server_key_version: "encryptionkey@0"
I20260809 15:40:46.906206 19765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "cb21e57f9eae4fc2a7651e0025620ca5"
format_stamp: "Formatted at 2026-08-09 15:40:46 on dist-test-slave-jztv"
server_key: "63a07f74d89d7a4804d7958b16c26d63"
server_key_iv: "03e1f418bd34c9d1ab30fed28c702876"
server_key_version: "encryptionkey@0"
I20260809 15:40:46.910005 19765 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:46.912569 19789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:46.913760 19765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:46.913918 19765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "cb21e57f9eae4fc2a7651e0025620ca5"
format_stamp: "Formatted at 2026-08-09 15:40:46 on dist-test-slave-jztv"
server_key: "63a07f74d89d7a4804d7958b16c26d63"
server_key_iv: "03e1f418bd34c9d1ab30fed28c702876"
server_key_version: "encryptionkey@0"
I20260809 15:40:46.914037 19765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:46.938349 19765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:46.941581 19765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:46.941799 19765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:46.949190 19765 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:36041
I20260809 15:40:46.949214 19865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:36041 every 8 connection(s)
I20260809 15:40:46.950318 19765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:46.953153 19866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:46.958767 19866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5: Bootstrap starting.
I20260809 15:40:46.959784 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19765
I20260809 15:40:46.959896 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:46.960227 14398 external_mini_cluster.cc:1428] Setting key 498a555ef2b750622efdbfa13ce84749
I20260809 15:40:46.961727 19866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:46.962582 19866 log.cc:824] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:46.964520 19866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5: No bootstrap required, opened a new log
I20260809 15:40:46.968289 19866 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } }
I20260809 15:40:46.968565 19866 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:46.968648 19866 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb21e57f9eae4fc2a7651e0025620ca5, State: Initialized, Role: FOLLOWER
Aug 09 15:40:46 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:46.969122 19866 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } }
I20260809 15:40:46.969281 19866 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:46.969353 19866 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:46.969492 19866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:46.970629 19866 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } }
I20260809 15:40:46.971045 19866 leader_election.cc:302] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb21e57f9eae4fc2a7651e0025620ca5; no voters:
I20260809 15:40:46.971449 19866 leader_election.cc:288] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:46.971522 19871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:46.971750 19871 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [term 1 LEADER]: Becoming Leader. State: Replica: cb21e57f9eae4fc2a7651e0025620ca5, State: Running, Role: LEADER
I20260809 15:40:46.972121 19871 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } }
I20260809 15:40:46.972826 19866 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:46.973989 19873 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } } }
I20260809 15:40:46.974116 19873 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:46.974694 19874 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb21e57f9eae4fc2a7651e0025620ca5. Latest consensus state: current_term: 1 leader_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb21e57f9eae4fc2a7651e0025620ca5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36041 } } }
I20260809 15:40:46.974897 19874 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:46.975307 19884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:46.976073 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:46.961462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.14.15.190:36041)
0809 15:40:46.961964 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:46.961981 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:46.962017 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:46.962760 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:46.962789 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:46.963142 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:46.963488 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:46.964325 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:46.965380 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:46.966290 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:46.966803 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:46.966985 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:46.969931 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:46.969936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:46.969950 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:46.969985 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:46.972013 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:46.972529 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:46.972533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:46.972538 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:46.972647 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:46.972996 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:46.972999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:46.973001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:46.973522 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:46.974361 (+ 839us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:46.974511 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 15:40:46.974824 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":171,"threads_started":1}
I20260809 15:40:46.978602 19884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:46.984496 19884 catalog_manager.cc:1347] Generated new cluster ID: c2b0f27e2e2246d6a173f656b2246b3e
I20260809 15:40:46.984575 19884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:46.997924 19884 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:46.999323 19884 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:47.012516 19884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb21e57f9eae4fc2a7651e0025620ca5: Generated new TSK 0
I20260809 15:40:47.013407 19884 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:47.047606 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:47.161164 19906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:47.161485 19906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:47.161566 19906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:47.165591 19906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:47.165683 19906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:47.165774 19906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:47.170915 19906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:47.171947 19906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:47.173012 19906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:47.182796 19911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:47.182868 19906 server_base.cc:1034] running on GCE node
W20260809 15:40:47.182806 19915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:47.182811 19912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:47.183455 19906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:47.184125 19906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:47.185324 19906 hybrid_clock.cc:648] HybridClock initialized: now 1786290047185303 us; error 32 us; skew 500 ppm
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:47.188356 19906 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:47.189330 19906 webserver.cc:460] Webserver started at http://127.14.15.129:41821/ using document root <none> and password file <none>
I20260809 15:40:47.189898 19906 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:47.190001 19906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:47.190320 19906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:47.192374 19906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "64d04754e8974c18b5c39973e2bcd9fc"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "a0cb0d75c3e3a79cb61039e9bc70ca8f"
server_key_iv: "2e96dea3cece7eabed13aec506769929"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.192957 19906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "64d04754e8974c18b5c39973e2bcd9fc"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "a0cb0d75c3e3a79cb61039e9bc70ca8f"
server_key_iv: "2e96dea3cece7eabed13aec506769929"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.196910 19906 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 15:40:47.199399 19923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.200546 19906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:47.200685 19906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "64d04754e8974c18b5c39973e2bcd9fc"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "a0cb0d75c3e3a79cb61039e9bc70ca8f"
server_key_iv: "2e96dea3cece7eabed13aec506769929"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.200800 19906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:47.227890 19906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:47.231323 19906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:47.231562 19906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:47.232195 19906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:47.233067 19906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:47.233141 19906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.233219 19906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:47.233268 19906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.242333 19906 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:43585
I20260809 15:40:47.242367 20088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:43585 every 8 connection(s)
I20260809 15:40:47.243243 19906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:47.245193 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 19906
I20260809 15:40:47.245345 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:47.245687 14398 external_mini_cluster.cc:1428] Setting key 8ae1275fe9c98db69c3a13c3965ae0a5
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:47.258551 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.245023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:54675 (local address 127.14.15.190:36041)
0809 15:40:47.245206 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:47.245213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:47.246110 (+ 897us) server_negotiation.cc:407] Connection header received
0809 15:40:47.247582 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:47.247585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:47.247645 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:47.247742 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:47.248917 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.249616 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.251418 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.251663 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.251748 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.254846 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:47.254849 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:47.254852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:47.254882 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:47.256365 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.256971 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.256974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.256975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.257054 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.257375 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.257378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.257379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.257674 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:47.257756 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:47.258284 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 15:40:47.258402 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:47.259570 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.245486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36041 (local address 127.14.15.129:54675)
0809 15:40:47.245953 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:47.246007 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:47.247367 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:47.247901 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:47.247907 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:47.248268 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:47.248758 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.248772 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.249756 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.249762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.251275 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.251291 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.251827 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.251834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.252083 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.252869 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:47.252892 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:47.254669 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:47.256519 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.256526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.256545 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.256869 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.257136 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.257138 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.257140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.257270 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.257773 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:47.257778 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:47.258013 (+ 235us) client_negotiation.cc:769] Sending connection context
0809 15:40:47.258166 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 15:40:47.258488 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":138,"threads_started":1}
I20260809 15:40:47.260905 20089 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36041
I20260809 15:40:47.261159 20089 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:47.261683 20089 heartbeater.cc:511] Master 127.14.15.190:36041 requested a full tablet report, sending...
I20260809 15:40:47.263259 19812 ts_manager.cc:194] Registered new tserver with Master: 64d04754e8974c18b5c39973e2bcd9fc (127.14.15.129:43585)
I20260809 15:40:47.264397 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:54675
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:47.277305 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:47.391217 20099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:47.391523 20099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:47.391597 20099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:47.395742 20099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:47.395833 20099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:47.395932 20099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:47.401337 20099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:47.402508 20099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:47.403554 20099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:40:47.413615 20099 server_base.cc:1034] running on GCE node
W20260809 15:40:47.413537 20110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:47.413537 20106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:47.413635 20107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:47.414368 20099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:47.414969 20099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:47.416232 20099 hybrid_clock.cc:648] HybridClock initialized: now 1786290047416212 us; error 31 us; skew 500 ppm
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:47.419322 20099 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:47.420328 20099 webserver.cc:460] Webserver started at http://127.14.15.130:36271/ using document root <none> and password file <none>
I20260809 15:40:47.420871 20099 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:47.420933 20099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:47.421104 20099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:47.423199 20099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "06c2b0769e6a46ca9ae64d4f8dcb531b"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "573be1c6261da4055152242afdcbc711"
server_key_iv: "b03edaa9d3598e9b4dfbd6952155182c"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.423720 20099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "06c2b0769e6a46ca9ae64d4f8dcb531b"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "573be1c6261da4055152242afdcbc711"
server_key_iv: "b03edaa9d3598e9b4dfbd6952155182c"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.427538 20099 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:47.430027 20122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.431387 20099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:47.431530 20099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "06c2b0769e6a46ca9ae64d4f8dcb531b"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "573be1c6261da4055152242afdcbc711"
server_key_iv: "b03edaa9d3598e9b4dfbd6952155182c"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.431644 20099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:47.453080 20099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:47.456602 20099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:47.456774 20099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:47.457369 20099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:47.458261 20099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:47.458310 20099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.458354 20099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:47.458369 20099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.469647 20099 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:33129
I20260809 15:40:47.469667 20296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:33129 every 8 connection(s)
I20260809 15:40:47.470714 20099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:47.474984 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 20099
I20260809 15:40:47.475152 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:47.475529 14398 external_mini_cluster.cc:1428] Setting key 7d11cbec0c378e2f7b780e00d7e1ed3b
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:40:47.487084 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.472639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:59661 (local address 127.14.15.190:36041)
0809 15:40:47.472811 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:47.472815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:47.473831 (+ 1016us) server_negotiation.cc:407] Connection header received
0809 15:40:47.475496 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:47.475500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:47.475562 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:47.475662 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:47.477039 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.477683 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.479526 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.479941 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.480078 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.482944 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:47.482948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:47.482951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:47.482982 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:47.484540 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.485222 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.485225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.485226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.485320 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.485791 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.485794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.485795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.486011 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:47.486144 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:47.486774 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 15:40:47.486911 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 15:40:47.487991 20299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.473014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36041 (local address 127.14.15.130:59661)
0809 15:40:47.473631 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:47.473693 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:47.475236 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:47.476007 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:47.476014 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:47.476375 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:47.476861 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.476875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.477825 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.477832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.479375 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.479387 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.480101 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.480103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.480249 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.480906 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:47.480923 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:47.482739 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:47.484672 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.484679 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.484697 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.485080 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.485439 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.485443 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.485444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.485652 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.486156 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:47.486165 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:47.486516 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 15:40:47.486716 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 15:40:47.487090 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":115,"threads_started":1}
I20260809 15:40:47.489395 20297 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36041
I20260809 15:40:47.489811 20297 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:47.490490 20297 heartbeater.cc:511] Master 127.14.15.190:36041 requested a full tablet report, sending...
I20260809 15:40:47.491762 19812 ts_manager.cc:194] Registered new tserver with Master: 06c2b0769e6a46ca9ae64d4f8dcb531b (127.14.15.130:33129)
I20260809 15:40:47.492517 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:59661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:47.509399 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:47.627533 20304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:47.627833 20304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:47.627911 20304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:47.631985 20304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:47.632081 20304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:47.632174 20304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:47.637590 20304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:47.638792 20304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:47.639858 20304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:47.649974 20310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:47.649974 20311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:47.650115 20313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:47.650266 20304 server_base.cc:1034] running on GCE node
I20260809 15:40:47.650841 20304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:47.651541 20304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:47.652734 20304 hybrid_clock.cc:648] HybridClock initialized: now 1786290047652717 us; error 27 us; skew 500 ppm
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:47.655570 20304 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:47.656476 20304 webserver.cc:460] Webserver started at http://127.14.15.131:38273/ using document root <none> and password file <none>
I20260809 15:40:47.657073 20304 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:47.657169 20304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:47.657421 20304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:47.659579 20304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "6f57f6ff0b6d419c8691dbcef2fc5b0d"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "92b0c83c6e31a430de228c36ddcb2a2a"
server_key_iv: "a06c69f42608d3549d9f8dc10bd60a0e"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.660195 20304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "6f57f6ff0b6d419c8691dbcef2fc5b0d"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "92b0c83c6e31a430de228c36ddcb2a2a"
server_key_iv: "a06c69f42608d3549d9f8dc10bd60a0e"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.664124 20304 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:47.666738 20329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.667900 20304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:47.668051 20304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "6f57f6ff0b6d419c8691dbcef2fc5b0d"
format_stamp: "Formatted at 2026-08-09 15:40:47 on dist-test-slave-jztv"
server_key: "92b0c83c6e31a430de228c36ddcb2a2a"
server_key_iv: "a06c69f42608d3549d9f8dc10bd60a0e"
server_key_version: "encryptionkey@0"
I20260809 15:40:47.668169 20304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:47.688822 20304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:47.691962 20304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:47.692181 20304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:47.692791 20304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:47.693655 20304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:47.693728 20304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.693802 20304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:47.693854 20304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:47.703225 20304 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:33145
I20260809 15:40:47.703246 20488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:33145 every 8 connection(s)
I20260809 15:40:47.704185 20304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:47.707465 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 20304
I20260809 15:40:47.707633 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:47.708021 14398 external_mini_cluster.cc:1428] Setting key b89ae216441b8e1af408a61cf7e10000
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:47.718375 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.706110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:45811 (local address 127.14.15.190:36041)
0809 15:40:47.706301 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:47.706306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:47.707137 (+ 831us) server_negotiation.cc:407] Connection header received
0809 15:40:47.708929 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:47.708935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:47.708995 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:47.709107 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:47.710622 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.711150 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.712247 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.712457 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.712532 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.715099 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:47.715102 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:47.715104 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:47.715129 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:47.716369 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.716848 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.716851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.716852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.716928 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.717241 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.717243 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.717244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.717468 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:47.717571 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:47.718073 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 15:40:47.718180 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:40:47.719274 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.706523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36041 (local address 127.14.15.131:45811)
0809 15:40:47.706980 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:47.707026 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:47.708670 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:47.709251 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:47.709258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:47.709787 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:47.710484 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.710510 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.711258 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.711260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.712143 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:47.712153 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.712599 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.712602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:47.712747 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.713405 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:47.713422 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:47.714936 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:47.716474 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.716480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.716493 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.716753 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.717010 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:47.717012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:47.717014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:47.717153 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:47.717571 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:47.717576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:47.717850 (+ 274us) client_negotiation.cc:769] Sending connection context
0809 15:40:47.718009 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 15:40:47.718366 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":121,"threads_started":1}
I20260809 15:40:47.720456 20489 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36041
I20260809 15:40:47.720731 20489 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:47.721392 20489 heartbeater.cc:511] Master 127.14.15.190:36041 requested a full tablet report, sending...
I20260809 15:40:47.722535 19812 ts_manager.cc:194] Registered new tserver with Master: 6f57f6ff0b6d419c8691dbcef2fc5b0d (127.14.15.131:33145)
I20260809 15:40:47.723085 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:45811
I20260809 15:40:47.734668 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:47.762799 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.752811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40584 (local address 127.14.15.129:43585)
0809 15:40:47.753123 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:47.753140 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:47.753168 (+ 28us) server_negotiation.cc:407] Connection header received
0809 15:40:47.753260 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:47.753267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:47.753476 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:47.753637 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:47.754410 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.755217 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.756076 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.756446 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.756568 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.759098 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:47.759107 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:47.759119 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:47.759144 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:47.760879 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.761364 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.761377 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.761379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.761460 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.761750 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.761753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.761755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.762018 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:47.762271 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:47.762459 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 15:40:47.762610 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":68,"threads_started":1}
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[19748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:47.775182 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:47.765824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.14.15.190:36041)
0809 15:40:47.766017 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:47.766023 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:47.766168 (+ 145us) server_negotiation.cc:407] Connection header received
0809 15:40:47.766339 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:47.766341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:47.766387 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:47.766482 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:47.767238 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.768113 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.769154 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:47.769363 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:47.769448 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:47.771955 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:47.771958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:47.771960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:47.771985 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:47.773328 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.773785 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.773788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.773790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.773929 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:47.774238 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:47.774241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:47.774243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:47.774486 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:47.774627 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:47.774890 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:40:47.775012 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 15:40:47.775611 19812 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52540
I20260809 15:40:47.776258 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19906
I20260809 15:40:47.791960 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 20099
I20260809 15:40:47.807650 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 20304
I20260809 15:40:47.821563 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 19765
2026-08-09T15:40:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2442 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[20507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[20507](info): set up 2 sockets
Aug 09 15:40:47 dist-test-slave-jztv krb5kdc[20507](info): commencing operation
krb5kdc: starting...
W20260809 15:40:49.145689 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:49.277195 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41943
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:41943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:49.391214 20524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:49.391571 20524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:49.391665 20524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:49.395879 20524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:49.395967 20524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:49.396003 20524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:49.396061 20524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:49.396106 20524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:49.401698 20524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:41943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:49.402920 20524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:49.404006 20524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:49.412701 20530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:49.412714 20531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:49.412757 20524 server_base.cc:1034] running on GCE node
W20260809 15:40:49.412738 20537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:49.413491 20524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:49.414659 20524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:49.415822 20524 hybrid_clock.cc:648] HybridClock initialized: now 1786290049415791 us; error 41 us; skew 500 ppm
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:49.418737 20524 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:49.419494 20524 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:49.419603 20524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:49.419852 20524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:49.421947 20524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "fbbd35b9636a435ab25ccb6790438d0d"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "1e46cd114c4ae185f8038b6eb6ab3370"
server_key_iv: "8f16acb3634f17120fbe80326331c9cb"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.422577 20524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "fbbd35b9636a435ab25ccb6790438d0d"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "1e46cd114c4ae185f8038b6eb6ab3370"
server_key_iv: "8f16acb3634f17120fbe80326331c9cb"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.426376 20524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:40:49.429103 20543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.430405 20524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:40:49.430546 20524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "fbbd35b9636a435ab25ccb6790438d0d"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "1e46cd114c4ae185f8038b6eb6ab3370"
server_key_iv: "8f16acb3634f17120fbe80326331c9cb"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.430675 20524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:49.443249 20524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:49.446146 20524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:49.446373 20524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:49.453370 20524 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:41943
I20260809 15:40:49.453645 20628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:41943 every 8 connection(s)
I20260809 15:40:49.454077 20524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:49.454403 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 20524
I20260809 15:40:49.454536 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:49.454891 14398 external_mini_cluster.cc:1428] Setting key 346ce73b6660cbafd229a1449c81195a
I20260809 15:40:49.457257 20629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:49.462770 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: Bootstrap starting.
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:49.464982 20629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:49.465938 20629 log.cc:824] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:49.468298 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: No bootstrap required, opened a new log
I20260809 15:40:49.469285 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:49.456244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.14.15.190:41943)
0809 15:40:49.456701 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:49.456715 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:49.456751 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:49.457450 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:49.457467 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:49.457790 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:49.458120 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:49.458978 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.459999 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.460864 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.461328 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.461510 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:49.464036 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:49.464042 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:49.464053 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:49.464082 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:49.466137 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:49.466700 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:49.466705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:49.466709 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:49.466855 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:49.467141 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:49.467144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:49.467146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:49.467656 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:49.467846 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:49.468079 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 15:40:49.468372 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":141,"threads_started":1}
I20260809 15:40:49.472345 20629 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } }
I20260809 15:40:49.472559 20629 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:49.472596 20629 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbd35b9636a435ab25ccb6790438d0d, State: Initialized, Role: FOLLOWER
I20260809 15:40:49.473035 20629 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } }
I20260809 15:40:49.473209 20629 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:49.473287 20629 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:49.473404 20629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:49.474388 20629 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } }
I20260809 15:40:49.474722 20629 leader_election.cc:302] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbbd35b9636a435ab25ccb6790438d0d; no voters:
I20260809 15:40:49.475025 20629 leader_election.cc:288] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:49.475154 20634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:49.475402 20634 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [term 1 LEADER]: Becoming Leader. State: Replica: fbbd35b9636a435ab25ccb6790438d0d, State: Running, Role: LEADER
I20260809 15:40:49.475795 20634 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } }
I20260809 15:40:49.476293 20629 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:49.477479 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbbd35b9636a435ab25ccb6790438d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } } }
I20260809 15:40:49.477618 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:49.477936 20637 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbbd35b9636a435ab25ccb6790438d0d. Latest consensus state: current_term: 1 leader_uuid: "fbbd35b9636a435ab25ccb6790438d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbd35b9636a435ab25ccb6790438d0d" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41943 } } }
I20260809 15:40:49.478047 20637 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:49.478413 20649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:49.481101 20649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:49.487186 20649 catalog_manager.cc:1347] Generated new cluster ID: f0f0fe47016842d5b36ab35233b098f3
I20260809 15:40:49.487265 20649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:49.508270 20649 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:49.509224 20649 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:49.516762 20649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: Generated new TSK 0
I20260809 15:40:49.517488 20649 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:49.557672 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:49.687752 20668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:49.688040 20668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:49.688086 20668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:49.692168 20668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:49.692224 20668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:49.692283 20668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:49.697434 20668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:49.698549 20668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:49.699579 20668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:49.708976 20676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:49.709003 20677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:49.709086 20668 server_base.cc:1034] running on GCE node
W20260809 15:40:49.709003 20680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:49.709558 20668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:49.710176 20668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:49.711378 20668 hybrid_clock.cc:648] HybridClock initialized: now 1786290049711361 us; error 31 us; skew 500 ppm
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:49.717329 20668 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:49.718140 20668 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:49.718251 20668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:49.718516 20668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:49.720683 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "1a02749d6bb24639976ca9df95282e77"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "62cd7f2d1f2cf02846cf06901f2631a9"
server_key_iv: "1d42e4d11a847e95e9ae2077a5bd4527"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.721280 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "1a02749d6bb24639976ca9df95282e77"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "62cd7f2d1f2cf02846cf06901f2631a9"
server_key_iv: "1d42e4d11a847e95e9ae2077a5bd4527"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.725328 20668 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:49.728116 20688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.729417 20668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:40:49.729560 20668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "1a02749d6bb24639976ca9df95282e77"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "62cd7f2d1f2cf02846cf06901f2631a9"
server_key_iv: "1d42e4d11a847e95e9ae2077a5bd4527"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.729683 20668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:49.753348 20668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:49.756816 20668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:49.757041 20668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:49.757695 20668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:49.758615 20668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:49.758665 20668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.758708 20668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:49.758765 20668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.768071 20668 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:34071
I20260809 15:40:49.768101 20864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:34071 every 8 connection(s)
I20260809 15:40:49.768728 20668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:49.776270 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 20668
I20260809 15:40:49.776401 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:49.776770 14398 external_mini_cluster.cc:1428] Setting key 48e755073506da026ce52cba350c1b83
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:49.784538 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:49.770615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:53791 (local address 127.14.15.190:41943)
0809 15:40:49.770767 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:49.770771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:49.771492 (+ 721us) server_negotiation.cc:407] Connection header received
0809 15:40:49.772824 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:49.772828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:49.772888 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:49.772993 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:49.774749 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.775588 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.777325 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.777603 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.777753 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:49.780874 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:49.780878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:49.780880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:49.780921 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:49.782400 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:49.782933 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:49.782936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:49.782938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:49.783032 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:49.783392 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:49.783396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:49.783398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:49.783595 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:49.783703 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:49.784227 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 15:40:49.784363 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:40:49.785354 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:49.770885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41943 (local address 127.14.15.129:53791)
0809 15:40:49.771336 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:49.771379 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:49.772604 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:49.773179 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:49.773188 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:49.773726 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:49.774518 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:49.774543 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.775737 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.775741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:49.777192 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:49.777204 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:49.778030 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:49.778035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:49.778289 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:49.778989 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:49.779006 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:49.780700 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:49.782522 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:49.782527 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:49.782544 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:49.782821 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:49.783137 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:49.783141 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:49.783143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:49.783288 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:49.783717 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:49.783725 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:49.783976 (+ 251us) client_negotiation.cc:769] Sending connection context
0809 15:40:49.784169 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:40:49.784504 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260809 15:40:49.786751 20865 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41943
I20260809 15:40:49.787045 20865 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:49.787639 20865 heartbeater.cc:511] Master 127.14.15.190:41943 requested a full tablet report, sending...
I20260809 15:40:49.789235 20576 ts_manager.cc:194] Registered new tserver with Master: 1a02749d6bb24639976ca9df95282e77 (127.14.15.129:34071)
I20260809 15:40:49.790429 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:53791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:49.809875 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:49.925060 20872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:49.925314 20872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:49.925392 20872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:49.929412 20872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:49.929473 20872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:49.929533 20872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:49.935083 20872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:49.936141 20872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:49.937165 20872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:49.946806 20883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:49.946825 20880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:49.946913 20879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:49.947057 20872 server_base.cc:1034] running on GCE node
I20260809 15:40:49.947547 20872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:49.948202 20872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:49.949389 20872 hybrid_clock.cc:648] HybridClock initialized: now 1786290049949352 us; error 50 us; skew 500 ppm
Aug 09 15:40:49 dist-test-slave-jztv krb5kdc[20507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:49.952212 20872 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:49.952944 20872 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:49.953042 20872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:49.953290 20872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:49.955389 20872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "36da4e70047c4d03ba4661c2429d86f3"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "83cf3bd65525e632d41e094d5036f09d"
server_key_iv: "29dd5779e3f5d7d495a147057869ce42"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.955976 20872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "36da4e70047c4d03ba4661c2429d86f3"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "83cf3bd65525e632d41e094d5036f09d"
server_key_iv: "29dd5779e3f5d7d495a147057869ce42"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.959910 20872 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:49.962493 20894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.963733 20872 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:49.963878 20872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "36da4e70047c4d03ba4661c2429d86f3"
format_stamp: "Formatted at 2026-08-09 15:40:49 on dist-test-slave-jztv"
server_key: "83cf3bd65525e632d41e094d5036f09d"
server_key_iv: "29dd5779e3f5d7d495a147057869ce42"
server_key_version: "encryptionkey@0"
I20260809 15:40:49.964001 20872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:49.993288 20872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:49.996500 20872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:49.996721 20872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:49.997340 20872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:49.998236 20872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:49.998284 20872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:49.998354 20872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:49.998391 20872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:50.007159 20872 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:42945
I20260809 15:40:50.007189 21051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:42945 every 8 connection(s)
I20260809 15:40:50.007787 20872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:50.007978 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 20872
I20260809 15:40:50.008123 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:50.008474 14398 external_mini_cluster.cc:1428] Setting key a9e511fc7f0fcc18fe3423677a1cdab7
Aug 09 15:40:50 dist-test-slave-jztv krb5kdc[20507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290049, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:50.022593 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.009830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:49767 (local address 127.14.15.190:41943)
0809 15:40:50.009954 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.009959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.011043 (+ 1084us) server_negotiation.cc:407] Connection header received
0809 15:40:50.012338 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.012341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.012397 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.012476 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:50.013665 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.014266 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.015527 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.015773 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.015891 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.018741 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:50.018745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:50.018748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:50.018785 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:50.020378 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.020919 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.020922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.020924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.021022 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.021373 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.021377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.021379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.021584 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:50.021689 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.022348 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.022461 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:40:50.023869 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.010379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41943 (local address 127.14.15.130:49767)
0809 15:40:50.010870 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.010923 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.012131 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.012655 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.012661 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.013026 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:50.013509 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.013533 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.014407 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.014410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.015398 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.015409 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.015937 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.015941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.016186 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.016871 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:50.016897 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:50.018560 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:50.020510 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:50.020524 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:50.020543 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:50.020809 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:50.021118 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:50.021121 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:50.021124 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:50.021275 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:50.021700 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:50.021709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:50.022014 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.022291 (+ 277us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.022701 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":140,"threads_started":1}
I20260809 15:40:50.025127 21052 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41943
I20260809 15:40:50.025408 21052 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:50.025897 21052 heartbeater.cc:511] Master 127.14.15.190:41943 requested a full tablet report, sending...
I20260809 15:40:50.027554 20576 ts_manager.cc:194] Registered new tserver with Master: 36da4e70047c4d03ba4661c2429d86f3 (127.14.15.130:42945)
I20260809 15:40:50.028244 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:49767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:50.039208 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:50.158038 21059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:50.158422 21059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:50.158478 21059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:50.162680 21059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:50.162744 21059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:50.162807 21059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:50.168390 21059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:50.169441 21059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:50.170501 21059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:50.180550 21067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:50.180550 21066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:50.180565 21072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:50.180825 21059 server_base.cc:1034] running on GCE node
I20260809 15:40:50.181331 21059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:50.181948 21059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:50.183127 21059 hybrid_clock.cc:648] HybridClock initialized: now 1786290050183091 us; error 54 us; skew 500 ppm
Aug 09 15:40:50 dist-test-slave-jztv krb5kdc[20507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290050, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:50.185968 21059 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:50.186771 21059 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:50.186841 21059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:50.187013 21059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:50.189066 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "4596f3c2ae854d829a2ae2d16b43dcc8"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "08daab8d629dcc5be510fe8ddb23b62f"
server_key_iv: "bc88ffabebd29a15382a9cc8a993ce1a"
server_key_version: "encryptionkey@0"
I20260809 15:40:50.189610 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "4596f3c2ae854d829a2ae2d16b43dcc8"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "08daab8d629dcc5be510fe8ddb23b62f"
server_key_iv: "bc88ffabebd29a15382a9cc8a993ce1a"
server_key_version: "encryptionkey@0"
I20260809 15:40:50.193720 21059 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:50.196411 21079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:50.197690 21059 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:50.197835 21059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "4596f3c2ae854d829a2ae2d16b43dcc8"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "08daab8d629dcc5be510fe8ddb23b62f"
server_key_iv: "bc88ffabebd29a15382a9cc8a993ce1a"
server_key_version: "encryptionkey@0"
I20260809 15:40:50.197952 21059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:50.209208 21059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:50.212888 21059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:50.213119 21059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:50.213810 21059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:50.214838 21059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:50.214890 21059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:50.214965 21059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:50.214998 21059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:50.224723 21059 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:43625
I20260809 15:40:50.224766 21250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:43625 every 8 connection(s)
I20260809 15:40:50.225378 21059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:50.226733 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 21059
I20260809 15:40:50.226878 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:50.227192 14398 external_mini_cluster.cc:1428] Setting key 22f081a748b7e671cf3ad4a7f1099c05
Aug 09 15:40:50 dist-test-slave-jztv krb5kdc[20507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290050, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:50.239543 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.227508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39829 (local address 127.14.15.190:41943)
0809 15:40:50.227675 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.227682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.228715 (+ 1033us) server_negotiation.cc:407] Connection header received
0809 15:40:50.230031 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.230033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.230088 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.230158 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:50.231346 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.231864 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.233103 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.233322 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.233405 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.236226 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:50.236229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:50.236232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:50.236256 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:50.237511 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.238019 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.238021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.238023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.238111 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.238522 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.238525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.238526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.238711 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:50.238791 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.239275 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.239396 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:40:50.240521 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.227999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41943 (local address 127.14.15.131:39829)
0809 15:40:50.228577 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.228633 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.229844 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.230361 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.230368 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.230735 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:50.231221 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.231235 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.231978 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.231980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.232990 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.233000 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.233451 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.233454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.233610 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.234387 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:50.234408 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:50.236053 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:50.237628 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:50.237633 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:50.237645 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:50.237930 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:50.238268 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:50.238272 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:50.238274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:50.238434 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:50.238806 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:50.238811 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:50.239058 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.239211 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.239521 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":167,"threads_started":1}
I20260809 15:40:50.241585 21252 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41943
I20260809 15:40:50.241844 21252 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:50.242408 21252 heartbeater.cc:511] Master 127.14.15.190:41943 requested a full tablet report, sending...
I20260809 15:40:50.243484 20576 ts_manager.cc:194] Registered new tserver with Master: 4596f3c2ae854d829a2ae2d16b43dcc8 (127.14.15.131:43625)
I20260809 15:40:50.244043 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:39829
I20260809 15:40:50.253515 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:40:50.263338 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.255681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58406 (local address 127.14.15.190:41943)
0809 15:40:50.255821 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.255825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.256062 (+ 237us) server_negotiation.cc:407] Connection header received
0809 15:40:50.256199 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.256202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.256252 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.256324 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:50.257044 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.257572 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.258452 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.258673 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.258791 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.260220 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:50.260225 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:50.260227 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:50.260260 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:50.261470 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.261937 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.261944 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.261946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.262030 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:50.262371 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:50.262374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:50.262376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:50.262622 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:50.262779 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.263034 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.263157 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:40:50.266477 20576 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58406:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:50.269826 20576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:50.288146 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.282077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42945 (local address 127.0.0.1:51090)
0809 15:40:50.282399 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.282412 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.282515 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.283264 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.283267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.283287 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:50.283412 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.283421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.284943 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.284946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.286310 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.286322 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.287595 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.287598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.287718 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.287757 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.287861 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.287994 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":139,"threads_started":1}
I20260809 15:40:50.288785 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.279088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.14.15.130:42945)
0809 15:40:50.281355 (+ 2267us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.281366 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.282617 (+ 1251us) server_negotiation.cc:407] Connection header received
0809 15:40:50.282707 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.282713 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.282931 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.283084 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:50.283545 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.284780 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.286451 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.287279 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.287383 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.287530 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.288532 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.288634 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2148,"thread_start_us":152,"threads_started":1}
I20260809 15:40:50.292251 20959 tablet_service.cc:1467] Processing CreateTablet for tablet 15d27db40618426ba941af3587b8cd20 (DEFAULT_TABLE table=test-table [id=31bba9b96e4741cdaf758e0919d16023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:50.293691 20959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d27db40618426ba941af3587b8cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:50.295492 21271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.279330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34071 (local address 127.0.0.1:56318)
0809 15:40:50.279771 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.279818 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.279959 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.281018 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.281024 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.281048 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:50.281209 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.281218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.292585 (+ 11367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.292589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.293791 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.293803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.295026 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.295030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.295148 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.295179 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.295239 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.295313 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":27,"thread_start_us":111,"threads_started":1}
I20260809 15:40:50.296283 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.280140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56318 (local address 127.14.15.129:34071)
0809 15:40:50.280578 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.280585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.280612 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:40:50.280683 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.280687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.280844 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.281026 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:50.281371 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.292443 (+ 11072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.293955 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.294869 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.295795 (+ 926us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.295953 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.296014 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.296128 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":78,"threads_started":1}
I20260809 15:40:50.296355 21276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.279393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43625 (local address 127.0.0.1:49926)
0809 15:40:50.282392 (+ 2999us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.282437 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.283690 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.290206 (+ 6516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.290233 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.290255 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:50.290341 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.290348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.291797 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.291800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.294389 (+ 2589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.294400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.295937 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.295940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.296035 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.296064 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.296144 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.296217 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2894,"mutex_wait_us":33,"thread_start_us":130,"threads_started":1}
I20260809 15:40:50.296934 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.281594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49926 (local address 127.14.15.131:43625)
0809 15:40:50.289755 (+ 8161us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.289768 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.289793 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:40:50.289871 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.289877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.290069 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.290253 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:50.290453 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.291548 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.294771 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.295606 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.295717 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.295862 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.296673 (+ 811us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.296780 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8035,"thread_start_us":202,"threads_started":1}
I20260809 15:40:50.299412 20770 tablet_service.cc:1467] Processing CreateTablet for tablet 15d27db40618426ba941af3587b8cd20 (DEFAULT_TABLE table=test-table [id=31bba9b96e4741cdaf758e0919d16023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:50.299732 21153 tablet_service.cc:1467] Processing CreateTablet for tablet 15d27db40618426ba941af3587b8cd20 (DEFAULT_TABLE table=test-table [id=31bba9b96e4741cdaf758e0919d16023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:50.300562 20770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d27db40618426ba941af3587b8cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:50.300664 21153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d27db40618426ba941af3587b8cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:50.302402 21277 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Bootstrap starting.
I20260809 15:40:50.305398 21277 tablet_bootstrap.cc:654] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:50.306684 21277 log.cc:824] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:50.307811 21281 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Bootstrap starting.
I20260809 15:40:50.308233 21279 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Bootstrap starting.
I20260809 15:40:50.308790 21277 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: No bootstrap required, opened a new log
I20260809 15:40:50.309007 21277 ts_tablet_manager.cc:1397] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:40:50.310266 21281 tablet_bootstrap.cc:654] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:50.310487 21279 tablet_bootstrap.cc:654] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:50.311337 21279 log.cc:824] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:50.311465 21281 log.cc:824] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:50.312943 21277 raft_consensus.cc:348] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.313175 21277 raft_consensus.cc:374] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:50.313215 21277 raft_consensus.cc:729] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36da4e70047c4d03ba4661c2429d86f3, State: Initialized, Role: FOLLOWER
I20260809 15:40:50.313392 21279 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: No bootstrap required, opened a new log
I20260809 15:40:50.313589 21281 tablet_bootstrap.cc:492] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: No bootstrap required, opened a new log
I20260809 15:40:50.313602 21279 ts_tablet_manager.cc:1397] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:40:50.313609 21277 consensus_queue.cc:260] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.313908 21281 ts_tablet_manager.cc:1397] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:40:50.314258 21052 heartbeater.cc:503] Master 127.14.15.190:41943 was elected leader, sending a full tablet report...
I20260809 15:40:50.314646 21277 ts_tablet_manager.cc:1428] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:40:50.317972 21281 raft_consensus.cc:348] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.317972 21279 raft_consensus.cc:348] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.318262 21279 raft_consensus.cc:374] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:50.318329 21279 raft_consensus.cc:729] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a02749d6bb24639976ca9df95282e77, State: Initialized, Role: FOLLOWER
I20260809 15:40:50.318346 21281 raft_consensus.cc:374] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:50.318410 21281 raft_consensus.cc:729] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4596f3c2ae854d829a2ae2d16b43dcc8, State: Initialized, Role: FOLLOWER
I20260809 15:40:50.318810 21281 consensus_queue.cc:260] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.318810 21279 consensus_queue.cc:260] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.319515 20865 heartbeater.cc:503] Master 127.14.15.190:41943 was elected leader, sending a full tablet report...
I20260809 15:40:50.319802 21252 heartbeater.cc:503] Master 127.14.15.190:41943 was elected leader, sending a full tablet report...
I20260809 15:40:50.319901 21279 ts_tablet_manager.cc:1428] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260809 15:40:50.320489 21281 ts_tablet_manager.cc:1428] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
W20260809 15:40:50.476337 21255 tablet.cc:2369] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:50.508981 21055 tablet.cc:2369] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:50.520009 20866 tablet.cc:2369] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:50.677062 21288 raft_consensus.cc:482] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:50.677394 21288 raft_consensus.cc:504] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.678730 21288 leader_election.cc:288] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36da4e70047c4d03ba4661c2429d86f3 (127.14.15.130:42945), 4596f3c2ae854d829a2ae2d16b43dcc8 (127.14.15.131:43625)
I20260809 15:40:50.682840 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.679193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:56133 (local address 127.14.15.131:43625)
0809 15:40:50.679327 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.679334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.679671 (+ 337us) server_negotiation.cc:407] Connection header received
0809 15:40:50.679798 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.679801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.679873 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.679951 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:50.680265 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.680742 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.681838 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.682254 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.682377 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.682436 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.682623 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.682702 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:40:50.682858 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.679030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42945 (local address 127.14.15.129:50555)
0809 15:40:50.679458 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.679470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.679574 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.679871 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.679873 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.679893 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:50.680040 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.680047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.680845 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.680849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.681676 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.681685 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.682427 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.682430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.682530 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.682547 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.682650 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.682713 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":124,"threads_started":1}
I20260809 15:40:50.682863 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.679158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:50555 (local address 127.14.15.130:42945)
0809 15:40:50.679298 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.679303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.679569 (+ 266us) server_negotiation.cc:407] Connection header received
0809 15:40:50.679699 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.679702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.679760 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.679844 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:50.680172 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.680721 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.681816 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.682293 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.682415 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.682472 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.682680 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.682753 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:40:50.682890 21291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.679030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43625 (local address 127.14.15.129:56133)
0809 15:40:50.679545 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.679561 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:50.679691 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:50.679989 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:50.679992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:50.680008 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:50.680154 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.680161 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.680893 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.680895 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.681682 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:50.681691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.682376 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.682380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:50.682490 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.682515 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:40:50.682590 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:40:50.682688 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":32,"thread_start_us":113,"threads_started":1}
I20260809 15:40:50.683552 20990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d27db40618426ba941af3587b8cd20" candidate_uuid: "1a02749d6bb24639976ca9df95282e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36da4e70047c4d03ba4661c2429d86f3" is_pre_election: true
I20260809 15:40:50.683931 20990 raft_consensus.cc:2454] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a02749d6bb24639976ca9df95282e77 in term 0.
I20260809 15:40:50.684049 21183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d27db40618426ba941af3587b8cd20" candidate_uuid: "1a02749d6bb24639976ca9df95282e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" is_pre_election: true
I20260809 15:40:50.684335 21183 raft_consensus.cc:2454] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a02749d6bb24639976ca9df95282e77 in term 0.
I20260809 15:40:50.684487 20692 leader_election.cc:302] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a02749d6bb24639976ca9df95282e77, 36da4e70047c4d03ba4661c2429d86f3; no voters:
I20260809 15:40:50.684782 21288 raft_consensus.cc:2781] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:50.684870 21288 raft_consensus.cc:482] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:50.684931 21288 raft_consensus.cc:3037] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:50.686035 21288 raft_consensus.cc:504] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.686481 21288 leader_election.cc:288] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [CANDIDATE]: Term 1 election: Requested vote from peers 36da4e70047c4d03ba4661c2429d86f3 (127.14.15.130:42945), 4596f3c2ae854d829a2ae2d16b43dcc8 (127.14.15.131:43625)
I20260809 15:40:50.686892 20990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d27db40618426ba941af3587b8cd20" candidate_uuid: "1a02749d6bb24639976ca9df95282e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36da4e70047c4d03ba4661c2429d86f3"
I20260809 15:40:50.686896 21183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d27db40618426ba941af3587b8cd20" candidate_uuid: "1a02749d6bb24639976ca9df95282e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8"
I20260809 15:40:50.687024 21183 raft_consensus.cc:3037] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:50.687026 20990 raft_consensus.cc:3037] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:50.688370 21183 raft_consensus.cc:2454] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a02749d6bb24639976ca9df95282e77 in term 1.
I20260809 15:40:50.688370 20990 raft_consensus.cc:2454] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a02749d6bb24639976ca9df95282e77 in term 1.
I20260809 15:40:50.688723 20692 leader_election.cc:302] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a02749d6bb24639976ca9df95282e77, 36da4e70047c4d03ba4661c2429d86f3; no voters:
I20260809 15:40:50.688923 21288 raft_consensus.cc:2781] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:50.689167 21288 raft_consensus.cc:686] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 1 LEADER]: Becoming Leader. State: Replica: 1a02749d6bb24639976ca9df95282e77, State: Running, Role: LEADER
I20260809 15:40:50.689544 21288 consensus_queue.cc:237] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } }
I20260809 15:40:50.692955 20576 catalog_manager.cc:5495] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a02749d6bb24639976ca9df95282e77 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "1a02749d6bb24639976ca9df95282e77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a02749d6bb24639976ca9df95282e77" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260809 15:40:50.739760 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.736350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56328 (local address 127.14.15.129:34071)
0809 15:40:50.736486 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:50.736490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:50.736504 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:40:50.736650 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:50.736653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:50.736707 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:50.736795 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:40:50.737034 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.737531 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.738347 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:50.738559 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:50.738639 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:50.738912 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:40:50.739353 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:40:50.739457 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:50.739537 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 15:40:50.739590 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:40:50.745995 21183 raft_consensus.cc:1261] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 1 FOLLOWER]: Refusing update from remote peer 1a02749d6bb24639976ca9df95282e77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:50.745995 20990 raft_consensus.cc:1261] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 1 FOLLOWER]: Refusing update from remote peer 1a02749d6bb24639976ca9df95282e77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:50.746869 21288 consensus_queue.cc:1035] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4596f3c2ae854d829a2ae2d16b43dcc8" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:50.747121 21292 consensus_queue.cc:1035] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36da4e70047c4d03ba4661c2429d86f3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:50.755107 21296 mvcc.cc:205] Tried to move back new op lower bound from 7316644047847514112 to 7316644047627169792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644047847514112}]
I20260809 15:40:50.756752 21298 mvcc.cc:205] Tried to move back new op lower bound from 7316644047847514112 to 7316644047627169792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644047847514112}]
I20260809 15:40:50.758036 21299 mvcc.cc:205] Tried to move back new op lower bound from 7316644047847514112 to 7316644047627169792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644047847514112}]
I20260809 15:40:50.763891 20575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:50.764083 20575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:50.766649 20575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbbd35b9636a435ab25ccb6790438d0d: Sending DeleteTablet for 3 replicas of tablet 15d27db40618426ba941af3587b8cd20
I20260809 15:40:50.767566 21153 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d27db40618426ba941af3587b8cd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:50 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49926
I20260809 15:40:50.767565 20959 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d27db40618426ba941af3587b8cd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:50 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:51090
I20260809 15:40:50.767683 20770 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d27db40618426ba941af3587b8cd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:50 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:56318
I20260809 15:40:50.768152 21314 tablet_replica.cc:330] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: stopping tablet replica
I20260809 15:40:50.768467 21314 raft_consensus.cc:2229] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:50.768872 21314 raft_consensus.cc:2258] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:50.770385 21314 ts_tablet_manager.cc:1905] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:50.773108 21314 ts_tablet_manager.cc:1918] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:50.773207 21314 log.cc:1196] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/15d27db40618426ba941af3587b8cd20
I20260809 15:40:50.773526 21314 ts_tablet_manager.cc:1939] T 15d27db40618426ba941af3587b8cd20 P 1a02749d6bb24639976ca9df95282e77: Deleting consensus metadata
I20260809 15:40:50.773896 21312 tablet_replica.cc:330] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: stopping tablet replica
I20260809 15:40:50.774324 21312 raft_consensus.cc:2229] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:50.774438 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 20668
I20260809 15:40:50.777009 21312 raft_consensus.cc:2258] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:50.777685 21309 tablet_replica.cc:330] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: stopping tablet replica
I20260809 15:40:50.778036 21309 raft_consensus.cc:2229] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:50.778420 21309 raft_consensus.cc:2258] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:50.787392 21309 ts_tablet_manager.cc:1905] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:50.787951 21312 ts_tablet_manager.cc:1905] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:50.790591 21312 ts_tablet_manager.cc:1918] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:50.790591 21309 ts_tablet_manager.cc:1918] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:50.790705 21309 log.cc:1196] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/15d27db40618426ba941af3587b8cd20
I20260809 15:40:50.790705 21312 log.cc:1196] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/15d27db40618426ba941af3587b8cd20
I20260809 15:40:50.791051 21309 ts_tablet_manager.cc:1939] T 15d27db40618426ba941af3587b8cd20 P 4596f3c2ae854d829a2ae2d16b43dcc8: Deleting consensus metadata
I20260809 15:40:50.791051 21312 ts_tablet_manager.cc:1939] T 15d27db40618426ba941af3587b8cd20 P 36da4e70047c4d03ba4661c2429d86f3: Deleting consensus metadata
I20260809 15:40:50.792519 20551 catalog_manager.cc:4841] TS 4596f3c2ae854d829a2ae2d16b43dcc8 (127.14.15.131:43625): tablet 15d27db40618426ba941af3587b8cd20 (table test-table [id=31bba9b96e4741cdaf758e0919d16023]) successfully deleted
I20260809 15:40:50.792537 20548 catalog_manager.cc:4841] TS 36da4e70047c4d03ba4661c2429d86f3 (127.14.15.130:42945): tablet 15d27db40618426ba941af3587b8cd20 (table test-table [id=31bba9b96e4741cdaf758e0919d16023]) successfully deleted
W20260809 15:40:50.793658 20545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:34071 (error 108)
I20260809 15:40:50.794490 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 20872
I20260809 15:40:50.794678 21276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:50.794358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34071 (local address 127.0.0.1:56338)
0809 15:40:50.794489 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:50.794564 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 15:40:50.801893 20545 catalog_manager.cc:4584] TS 1a02749d6bb24639976ca9df95282e77 (127.14.15.129:34071): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15d27db40618426ba941af3587b8cd20: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34071: connect: Connection refused (error 111)
I20260809 15:40:50.809499 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 21059
I20260809 15:40:50.821987 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 20524
2026-08-09T15:40:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2999 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T15:40:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:50Z Disabled control of system clock
I20260809 15:40:50.860543 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35021
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 15:40:50.973994 21319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:50.974291 21319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:50.974331 21319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:50.978453 21319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:50.978514 21319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:50.978529 21319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:50.978546 21319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:50.978561 21319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:50.983280 21319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35021
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:50.984308 21319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:50.985773 21319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:50.994407 21328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:50.994405 21331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:50.994515 21319 server_base.cc:1034] running on GCE node
W20260809 15:40:50.994400 21326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:50.995253 21319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:50.996359 21319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:50.997545 21319 hybrid_clock.cc:648] HybridClock initialized: now 1786290050997524 us; error 31 us; skew 500 ppm
I20260809 15:40:50.999528 21319 webserver.cc:460] Webserver started at http://127.14.15.190:33007/ using document root <none> and password file <none>
I20260809 15:40:51.000120 21319 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:51.000185 21319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:51.000440 21319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:51.002590 21319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "c3d914495d5d4cacb6934b9e4adec859"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "52d4b5d9d869ffe8e9408341efb15f7a"
server_key_iv: "4cd119c2f42d9e71e5cebabc5756190e"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.003170 21319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "c3d914495d5d4cacb6934b9e4adec859"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "52d4b5d9d869ffe8e9408341efb15f7a"
server_key_iv: "4cd119c2f42d9e71e5cebabc5756190e"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.006843 21319 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:40:51.009189 21340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.010481 21319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:51.010633 21319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "c3d914495d5d4cacb6934b9e4adec859"
format_stamp: "Formatted at 2026-08-09 15:40:50 on dist-test-slave-jztv"
server_key: "52d4b5d9d869ffe8e9408341efb15f7a"
server_key_iv: "4cd119c2f42d9e71e5cebabc5756190e"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.010752 21319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:51.015316 21319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:51.015918 21319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:51.016105 21319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:51.022972 21319 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35021
I20260809 15:40:51.022975 21412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35021 every 8 connection(s)
I20260809 15:40:51.023953 21319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:51.026543 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 21319
I20260809 15:40:51.026635 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:51.026926 14398 external_mini_cluster.cc:1428] Setting key 78fe9ff3f243d5c2c36aa96bc59b7550
I20260809 15:40:51.027355 21413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:51.032407 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.028269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.14.15.190:35021)
0809 15:40:51.028897 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.028912 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.028948 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:51.029608 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.029624 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.029958 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.030324 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.031121 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.031125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.031136 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.031145 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.031199 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.031214 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.031325 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.031459 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.031743 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":140,"threads_started":1}
I20260809 15:40:51.034538 21413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: Bootstrap starting.
I20260809 15:40:51.036769 21413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:51.037531 21413 log.cc:824] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:51.039690 21413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: No bootstrap required, opened a new log
I20260809 15:40:51.043434 21413 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } }
I20260809 15:40:51.043690 21413 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:51.043784 21413 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d914495d5d4cacb6934b9e4adec859, State: Initialized, Role: FOLLOWER
I20260809 15:40:51.044256 21413 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } }
I20260809 15:40:51.044420 21413 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:51.044508 21413 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:51.044608 21413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:51.045542 21413 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } }
I20260809 15:40:51.045890 21413 leader_election.cc:302] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d914495d5d4cacb6934b9e4adec859; no voters:
I20260809 15:40:51.046283 21413 leader_election.cc:288] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:51.046451 21421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:51.046708 21421 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [term 1 LEADER]: Becoming Leader. State: Replica: c3d914495d5d4cacb6934b9e4adec859, State: Running, Role: LEADER
I20260809 15:40:51.047102 21421 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } }
I20260809 15:40:51.047710 21413 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:51.048904 21423 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3d914495d5d4cacb6934b9e4adec859. Latest consensus state: current_term: 1 leader_uuid: "c3d914495d5d4cacb6934b9e4adec859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } } }
I20260809 15:40:51.048954 21422 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3d914495d5d4cacb6934b9e4adec859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d914495d5d4cacb6934b9e4adec859" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35021 } } }
I20260809 15:40:51.049043 21423 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:51.049059 21422 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:51.049417 21437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:51.052779 21437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:51.058725 21437 catalog_manager.cc:1347] Generated new cluster ID: eed222a9d0f94eccb7f1f71afd70759e
I20260809 15:40:51.058810 21437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:51.074666 21437 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:51.074993 21437 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:51.085387 21437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: Generated new TSK 0
I20260809 15:40:51.086166 21437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:40:51.091229 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--builtin_ntp_servers=127.14.15.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 15:40:51.206921 21453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:51.207178 21453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:51.207252 21453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:51.211213 21453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:51.211264 21453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:51.211371 21453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:51.216743 21453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:51.217850 21453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:51.219280 21453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:51.229532 21460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:51.229563 21459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:51.229560 21462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:51.229907 21453 server_base.cc:1034] running on GCE node
I20260809 15:40:51.230369 21453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:51.230957 21453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:51.232123 21453 hybrid_clock.cc:648] HybridClock initialized: now 1786290051232108 us; error 25 us; skew 500 ppm
I20260809 15:40:51.233906 21453 webserver.cc:460] Webserver started at http://127.14.15.129:45545/ using document root <none> and password file <none>
I20260809 15:40:51.234540 21453 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:51.234613 21453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:51.234788 21453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:51.236778 21453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "d4b23ad6fbd14549b0268dfcc47fc75f"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "d54f49d602b3289997cec4fa3ac143ed"
server_key_iv: "5b1cf4ad37b97f7b75f8ad48688115e3"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.237308 21453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "d4b23ad6fbd14549b0268dfcc47fc75f"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "d54f49d602b3289997cec4fa3ac143ed"
server_key_iv: "5b1cf4ad37b97f7b75f8ad48688115e3"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.241072 21453 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 15:40:51.243685 21470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.244884 21453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:51.244979 21453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "d4b23ad6fbd14549b0268dfcc47fc75f"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "d54f49d602b3289997cec4fa3ac143ed"
server_key_iv: "5b1cf4ad37b97f7b75f8ad48688115e3"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.245080 21453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:51.249770 21453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:51.250458 21453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:51.250602 21453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:51.251086 21453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:51.251927 21453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:51.251976 21453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.252012 21453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:51.252034 21453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.260636 21453 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:33829
I20260809 15:40:51.260656 21641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:33829 every 8 connection(s)
I20260809 15:40:51.261543 21453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:51.267791 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.263345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:32867 (local address 127.14.15.190:35021)
0809 15:40:51.263503 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.263508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.264628 (+ 1120us) server_negotiation.cc:407] Connection header received
0809 15:40:51.266051 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.266054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.266096 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.266184 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.267313 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.267317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.267319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.267330 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.267350 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.267357 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.267439 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.267643 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.267681 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:40:51.268698 21646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.263790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35021 (local address 127.14.15.129:32867)
0809 15:40:51.264455 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.264497 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.265833 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.266412 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.266419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.266508 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.267035 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.267036 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.267099 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.267167 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.267467 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.267476 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.267482 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.267678 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.267919 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":115,"threads_started":1}
I20260809 15:40:51.268985 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 21453
I20260809 15:40:51.269238 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:51.269609 14398 external_mini_cluster.cc:1428] Setting key ff6563fc289902b3bde4eed010eb69c7
I20260809 15:40:51.270138 21643 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35021
I20260809 15:40:51.270426 21643 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:51.270879 21643 heartbeater.cc:511] Master 127.14.15.190:35021 requested a full tablet report, sending...
I20260809 15:40:51.271781 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--builtin_ntp_servers=127.14.15.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 15:40:51.272559 21363 ts_manager.cc:194] Registered new tserver with Master: d4b23ad6fbd14549b0268dfcc47fc75f (127.14.15.129:33829)
W20260809 15:40:51.386925 21649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:51.387204 21649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:51.387274 21649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:51.391598 21649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:51.391657 21649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:51.391744 21649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:51.396651 21649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:51.397791 21649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:51.399279 21649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:51.409204 21654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:51.409299 21649 server_base.cc:1034] running on GCE node
W20260809 15:40:51.409216 21658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:51.409266 21655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:51.409953 21649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:51.410616 21649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:51.411808 21649 hybrid_clock.cc:648] HybridClock initialized: now 1786290051411791 us; error 28 us; skew 500 ppm
I20260809 15:40:51.413748 21649 webserver.cc:460] Webserver started at http://127.14.15.130:39607/ using document root <none> and password file <none>
I20260809 15:40:51.414507 21649 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:51.414613 21649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:51.414861 21649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:51.417033 21649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "38622b727dd34bdab3665704e0cd76e6"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "cb17be2c58aa2ac582bbc1050204bc78"
server_key_iv: "5e98050bc714f657cb1f776638b41d43"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.417646 21649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "38622b727dd34bdab3665704e0cd76e6"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "cb17be2c58aa2ac582bbc1050204bc78"
server_key_iv: "5e98050bc714f657cb1f776638b41d43"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.421535 21649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:51.424449 21668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.425935 21649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 15:40:51.426071 21649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "38622b727dd34bdab3665704e0cd76e6"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "cb17be2c58aa2ac582bbc1050204bc78"
server_key_iv: "5e98050bc714f657cb1f776638b41d43"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.426204 21649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:51.431067 21649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:51.431721 21649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:51.431911 21649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:51.432509 21649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:51.433503 21649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:51.433553 21649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.433596 21649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:51.433652 21649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.443130 21649 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:40953
I20260809 15:40:51.443150 21834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:40953 every 8 connection(s)
I20260809 15:40:51.444108 21649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:51.449409 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 21649
I20260809 15:40:51.449560 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:51.449878 14398 external_mini_cluster.cc:1428] Setting key e13d9406728000efa891eb2f282e9652
I20260809 15:40:51.451246 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.446025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:48219 (local address 127.14.15.190:35021)
0809 15:40:51.446185 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.446190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.447413 (+ 1223us) server_negotiation.cc:407] Connection header received
0809 15:40:51.449166 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.449171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.449223 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.449349 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.450792 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.450795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.450799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.450812 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.450836 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.450845 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.450949 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.451071 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.451112 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:40:51.452203 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.446540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35021 (local address 127.14.15.130:48219)
0809 15:40:51.447241 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.447306 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.448895 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.449599 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.449610 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.449731 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.450567 (+ 836us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.450568 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.450610 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.450680 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.450942 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.450948 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.450952 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.451088 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.451324 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260809 15:40:51.452244 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--builtin_ntp_servers=127.14.15.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 15:40:51.454537 21835 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35021
I20260809 15:40:51.454808 21835 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:51.455255 21835 heartbeater.cc:511] Master 127.14.15.190:35021 requested a full tablet report, sending...
I20260809 15:40:51.456351 21363 ts_manager.cc:194] Registered new tserver with Master: 38622b727dd34bdab3665704e0cd76e6 (127.14.15.130:40953)
W20260809 15:40:51.571209 21838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:51.571521 21838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:51.571604 21838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:51.575711 21838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:51.575809 21838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:51.575906 21838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:51.580778 21838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:51.582019 21838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:51.583572 21838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:51.595202 21849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:51.595273 21846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:51.595232 21844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:51.595701 21838 server_base.cc:1034] running on GCE node
I20260809 15:40:51.596318 21838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:51.597173 21838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:51.598366 21838 hybrid_clock.cc:648] HybridClock initialized: now 1786290051598341 us; error 35 us; skew 500 ppm
I20260809 15:40:51.601011 21838 webserver.cc:460] Webserver started at http://127.14.15.131:33815/ using document root <none> and password file <none>
I20260809 15:40:51.601919 21838 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:51.601997 21838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:51.602196 21838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:51.604506 21838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "df8469a85f224614bf665e3b2c2f9d08"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "b29bd45866b48fc005ba1c75289419be"
server_key_iv: "7705402944ca89c339f8bfecfc058226"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.605155 21838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "df8469a85f224614bf665e3b2c2f9d08"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "b29bd45866b48fc005ba1c75289419be"
server_key_iv: "7705402944ca89c339f8bfecfc058226"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.609686 21838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 15:40:51.612800 21856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.614130 21838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:51.614295 21838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "df8469a85f224614bf665e3b2c2f9d08"
format_stamp: "Formatted at 2026-08-09 15:40:51 on dist-test-slave-jztv"
server_key: "b29bd45866b48fc005ba1c75289419be"
server_key_iv: "7705402944ca89c339f8bfecfc058226"
server_key_version: "encryptionkey@0"
I20260809 15:40:51.614424 21838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:51.619201 21838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:51.619856 21838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:51.620091 21838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:51.620676 21838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:51.621613 21838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:51.621686 21838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.621758 21838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:51.621801 21838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:51.631016 21838 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:40975
I20260809 15:40:51.631048 22018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:40975 every 8 connection(s)
I20260809 15:40:51.631904 21838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:51.638025 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.633732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:49397 (local address 127.14.15.190:35021)
0809 15:40:51.633912 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.633917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.635020 (+ 1103us) server_negotiation.cc:407] Connection header received
0809 15:40:51.636281 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.636283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.636322 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.636399 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.637484 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.637487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.637489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.637502 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.637525 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.637535 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.637625 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.637858 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.637906 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 15:40:51.638855 22023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.634154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35021 (local address 127.14.15.131:49397)
0809 15:40:51.634872 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.634913 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.636091 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.636561 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.636568 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.636656 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.637191 (+ 535us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.637193 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.637234 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.637298 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.637663 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.637671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.637682 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.637839 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.638037 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":115,"threads_started":1}
I20260809 15:40:51.640048 22019 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35021
I20260809 15:40:51.640293 22019 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:51.640643 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 21838
I20260809 15:40:51.640774 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:51.640825 22019 heartbeater.cc:511] Master 127.14.15.190:35021 requested a full tablet report, sending...
I20260809 15:40:51.641108 14398 external_mini_cluster.cc:1428] Setting key 98b1fe724c9ea5ea2f90365f02be3394
I20260809 15:40:51.641965 21363 ts_manager.cc:194] Registered new tserver with Master: df8469a85f224614bf665e3b2c2f9d08 (127.14.15.131:40975)
I20260809 15:40:51.643347 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:40:51.647222 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.645512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34902 (local address 127.14.15.190:35021)
0809 15:40:51.645680 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.645684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.645828 (+ 144us) server_negotiation.cc:407] Connection header received
0809 15:40:51.645992 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.645995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.646028 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.646123 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.646826 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.646830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.646832 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.646844 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.646865 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.646876 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.646976 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.647053 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.647097 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 15:40:51.650390 21363 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:40:51.653299 21363 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:40:51.665421 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.662147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40953 (local address 127.0.0.1:54048)
0809 15:40:51.663247 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.663259 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.663328 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.664191 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.664195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.664210 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.664665 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.664667 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.664678 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.664702 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.665102 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.665105 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.665108 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.665197 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.665274 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"thread_start_us":146,"threads_started":1}
I20260809 15:40:51.665485 22040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.662148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59244 (local address 127.14.15.131:40975)
0809 15:40:51.662615 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.662630 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.663023 (+ 393us) server_negotiation.cc:407] Connection header received
0809 15:40:51.663161 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.663169 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.663376 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.663540 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.664537 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.664547 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.664562 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.664577 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.664626 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.664666 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.664790 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.664951 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.665307 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":150,"threads_started":1}
I20260809 15:40:51.665678 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.662730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54048 (local address 127.14.15.130:40953)
0809 15:40:51.663187 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.663201 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.663346 (+ 145us) server_negotiation.cc:407] Connection header received
0809 15:40:51.663425 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.663432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.663607 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.663737 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.664848 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.664854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.664866 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.664878 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.664921 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.664959 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.665057 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.665436 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.665529 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":146,"threads_started":1}
I20260809 15:40:51.666472 22038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.661886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:33829 (local address 127.0.0.1:35708)
0809 15:40:51.662878 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.662943 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.663072 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.664873 (+ 1801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.664877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.664895 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.665308 (+ 413us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.665310 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.665321 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.665349 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.666167 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.666171 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.666174 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.666303 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.666338 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"thread_start_us":125,"threads_started":1}
I20260809 15:40:51.666348 22039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.661912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40975 (local address 127.0.0.1:59244)
0809 15:40:51.662878 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.662932 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.663057 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.663534 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.663540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.663615 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.664227 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.664230 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.664251 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.664323 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.664775 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.664784 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.664790 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.665631 (+ 841us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.665667 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":64,"threads_started":1}
I20260809 15:40:51.666767 22042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.662892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.14.15.129:33829)
0809 15:40:51.664430 (+ 1538us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.664443 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.664466 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:40:51.664516 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.664522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.664713 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.664888 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.665481 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.665948 (+ 467us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.665967 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.665983 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.666030 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.666066 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.666175 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.666414 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.666596 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1420,"thread_start_us":85,"threads_started":1}
I20260809 15:40:51.668651 21740 tablet_service.cc:1467] Processing CreateTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 (DEFAULT_TABLE table=test-table [id=3821c398135e4159a2024f946967eb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:51.668939 21551 tablet_service.cc:1467] Processing CreateTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 (DEFAULT_TABLE table=test-table [id=3821c398135e4159a2024f946967eb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:51.669356 21919 tablet_service.cc:1467] Processing CreateTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 (DEFAULT_TABLE table=test-table [id=3821c398135e4159a2024f946967eb2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:40:51.669799 21740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bd73e2ce4a4c5cbc722a05fd723778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:51.669976 21551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bd73e2ce4a4c5cbc722a05fd723778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:51.670284 21919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bd73e2ce4a4c5cbc722a05fd723778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:51.676059 22043 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Bootstrap starting.
I20260809 15:40:51.677414 22046 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Bootstrap starting.
I20260809 15:40:51.678633 22045 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Bootstrap starting.
I20260809 15:40:51.678789 22043 tablet_bootstrap.cc:654] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:51.679406 22046 tablet_bootstrap.cc:654] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:51.679723 22043 log.cc:824] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:51.680155 22046 log.cc:824] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:51.680742 22045 tablet_bootstrap.cc:654] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:51.681517 22045 log.cc:824] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:51.681945 22043 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: No bootstrap required, opened a new log
I20260809 15:40:51.682168 22043 ts_tablet_manager.cc:1397] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:40:51.683597 22045 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: No bootstrap required, opened a new log
I20260809 15:40:51.683854 22045 ts_tablet_manager.cc:1397] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:40:51.686955 22043 raft_consensus.cc:348] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.687316 22043 raft_consensus.cc:374] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:51.687377 22043 raft_consensus.cc:729] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b23ad6fbd14549b0268dfcc47fc75f, State: Initialized, Role: FOLLOWER
I20260809 15:40:51.687875 22046 tablet_bootstrap.cc:492] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: No bootstrap required, opened a new log
I20260809 15:40:51.687853 22043 consensus_queue.cc:260] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.688083 22046 ts_tablet_manager.cc:1397] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260809 15:40:51.688378 22045 raft_consensus.cc:348] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.688635 22045 raft_consensus.cc:374] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:51.688690 22045 raft_consensus.cc:729] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8469a85f224614bf665e3b2c2f9d08, State: Initialized, Role: FOLLOWER
I20260809 15:40:51.688901 22043 ts_tablet_manager.cc:1428] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260809 15:40:51.689154 22045 consensus_queue.cc:260] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.689299 21643 heartbeater.cc:503] Master 127.14.15.190:35021 was elected leader, sending a full tablet report...
I20260809 15:40:51.689812 22019 heartbeater.cc:503] Master 127.14.15.190:35021 was elected leader, sending a full tablet report...
I20260809 15:40:51.690145 22045 ts_tablet_manager.cc:1428] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:40:51.692492 22046 raft_consensus.cc:348] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.692759 22046 raft_consensus.cc:374] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:51.692826 22046 raft_consensus.cc:729] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38622b727dd34bdab3665704e0cd76e6, State: Initialized, Role: FOLLOWER
I20260809 15:40:51.693240 22046 consensus_queue.cc:260] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.694064 21835 heartbeater.cc:503] Master 127.14.15.190:35021 was elected leader, sending a full tablet report...
I20260809 15:40:51.694312 22046 ts_tablet_manager.cc:1428] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260809 15:40:51.695019 21836 tablet.cc:2369] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:51.762712 21645 tablet.cc:2369] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:40:51.882961 22020 tablet.cc:2369] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:40:51.916275 22054 raft_consensus.cc:482] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:51.916574 22054 raft_consensus.cc:504] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.917771 22054 leader_election.cc:288] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b23ad6fbd14549b0268dfcc47fc75f (127.14.15.129:33829), df8469a85f224614bf665e3b2c2f9d08 (127.14.15.131:40975)
I20260809 15:40:51.920251 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.918182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40975 (local address 127.14.15.130:32773)
0809 15:40:51.918325 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.918344 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.918441 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.918901 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.918905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.918924 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.919537 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.919540 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.919567 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.919616 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.919955 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.919958 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.919961 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.920068 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.920110 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 15:40:51.920293 22040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.918448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:32773 (local address 127.14.15.131:40975)
0809 15:40:51.918588 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.918593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.918610 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:40:51.918664 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.918670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.918715 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.918804 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.919789 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.919796 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.919800 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.919815 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.919841 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.919855 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.919963 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.920091 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.920155 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:40:51.920717 22055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.918182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:33829 (local address 127.14.15.130:46077)
0809 15:40:51.918959 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:51.918975 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:51.919088 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:51.919416 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:51.919425 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:51.919440 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:51.920032 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:40:51.920035 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:51.920048 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:40:51.920074 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:51.920410 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:51.920413 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:51.920418 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:40:51.920511 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 15:40:51.920550 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":328,"thread_start_us":173,"threads_started":1}
I20260809 15:40:51.920791 22042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.918389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:46077 (local address 127.14.15.129:33829)
0809 15:40:51.918543 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.918547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.919116 (+ 569us) server_negotiation.cc:407] Connection header received
0809 15:40:51.919177 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.919180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.919224 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.919313 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.920206 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.920210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.920212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.920224 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.920247 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.920256 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.920359 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.920528 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.920654 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:40:51.921167 21954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bd73e2ce4a4c5cbc722a05fd723778" candidate_uuid: "38622b727dd34bdab3665704e0cd76e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8469a85f224614bf665e3b2c2f9d08" is_pre_election: true
I20260809 15:40:51.921391 21581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bd73e2ce4a4c5cbc722a05fd723778" candidate_uuid: "38622b727dd34bdab3665704e0cd76e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" is_pre_election: true
I20260809 15:40:51.921530 21954 raft_consensus.cc:2454] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38622b727dd34bdab3665704e0cd76e6 in term 0.
I20260809 15:40:51.921658 21581 raft_consensus.cc:2454] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38622b727dd34bdab3665704e0cd76e6 in term 0.
I20260809 15:40:51.922072 21672 leader_election.cc:302] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 38622b727dd34bdab3665704e0cd76e6, d4b23ad6fbd14549b0268dfcc47fc75f, df8469a85f224614bf665e3b2c2f9d08; no voters:
I20260809 15:40:51.922425 22054 raft_consensus.cc:2781] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:40:51.922519 22054 raft_consensus.cc:482] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:40:51.922565 22054 raft_consensus.cc:3037] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:51.923636 22054 raft_consensus.cc:504] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.924055 22054 leader_election.cc:288] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [CANDIDATE]: Term 1 election: Requested vote from peers d4b23ad6fbd14549b0268dfcc47fc75f (127.14.15.129:33829), df8469a85f224614bf665e3b2c2f9d08 (127.14.15.131:40975)
I20260809 15:40:51.924530 21954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bd73e2ce4a4c5cbc722a05fd723778" candidate_uuid: "38622b727dd34bdab3665704e0cd76e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8469a85f224614bf665e3b2c2f9d08"
I20260809 15:40:51.924551 21581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bd73e2ce4a4c5cbc722a05fd723778" candidate_uuid: "38622b727dd34bdab3665704e0cd76e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f"
I20260809 15:40:51.924685 21581 raft_consensus.cc:3037] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:51.924685 21954 raft_consensus.cc:3037] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:51.926342 21954 raft_consensus.cc:2454] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38622b727dd34bdab3665704e0cd76e6 in term 1.
I20260809 15:40:51.926342 21581 raft_consensus.cc:2454] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38622b727dd34bdab3665704e0cd76e6 in term 1.
I20260809 15:40:51.926663 21672 leader_election.cc:302] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38622b727dd34bdab3665704e0cd76e6, d4b23ad6fbd14549b0268dfcc47fc75f; no voters:
I20260809 15:40:51.926921 22054 raft_consensus.cc:2781] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:51.927109 22054 raft_consensus.cc:686] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 1 LEADER]: Becoming Leader. State: Replica: 38622b727dd34bdab3665704e0cd76e6, State: Running, Role: LEADER
I20260809 15:40:51.927482 22054 consensus_queue.cc:237] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } }
I20260809 15:40:51.930814 21361 catalog_manager.cc:5495] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38622b727dd34bdab3665704e0cd76e6 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "38622b727dd34bdab3665704e0cd76e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38622b727dd34bdab3665704e0cd76e6" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40953 } health_report { overall_health: HEALTHY } } }
I20260809 15:40:51.959244 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:51.957475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54052 (local address 127.14.15.130:40953)
0809 15:40:51.957633 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:51.957638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:51.957654 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:40:51.957755 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:51.957758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:51.957819 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:51.957916 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:51.958772 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:51.958777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:51.958779 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:51.958792 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:51.958821 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:51.958829 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:51.958931 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:51.959047 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 15:40:51.959090 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:40:51.965996 21581 raft_consensus.cc:1261] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 1 FOLLOWER]: Refusing update from remote peer 38622b727dd34bdab3665704e0cd76e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:51.965996 21954 raft_consensus.cc:1261] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 1 FOLLOWER]: Refusing update from remote peer 38622b727dd34bdab3665704e0cd76e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:40:51.966866 22056 consensus_queue.cc:1035] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8469a85f224614bf665e3b2c2f9d08" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:51.967068 22054 consensus_queue.cc:1035] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b23ad6fbd14549b0268dfcc47fc75f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 33829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:51.974490 22059 mvcc.cc:205] Tried to move back new op lower bound from 7316644052843274240 to 7316644052697473024. Current Snapshot: MvccSnapshot[applied={T|T < 7316644052843274240}]
I20260809 15:40:51.975658 22061 mvcc.cc:205] Tried to move back new op lower bound from 7316644052843274240 to 7316644052697473024. Current Snapshot: MvccSnapshot[applied={T|T < 7316644052843274240}]
I20260809 15:40:51.983368 21361 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:51.983522 21361 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:40:51.985893 21361 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3d914495d5d4cacb6934b9e4adec859: Sending DeleteTablet for 3 replicas of tablet c9bd73e2ce4a4c5cbc722a05fd723778
I20260809 15:40:51.986719 21551 tablet_service.cc:1514] Processing DeleteTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:51 UTC) from {username='slave'} at 127.0.0.1:35708
I20260809 15:40:51.986745 21919 tablet_service.cc:1514] Processing DeleteTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:51 UTC) from {username='slave'} at 127.0.0.1:59244
I20260809 15:40:51.987270 22070 tablet_replica.cc:330] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: stopping tablet replica
I20260809 15:40:51.987298 21740 tablet_service.cc:1514] Processing DeleteTablet for tablet c9bd73e2ce4a4c5cbc722a05fd723778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:40:51 UTC) from {username='slave'} at 127.0.0.1:54048
I20260809 15:40:51.987639 22070 raft_consensus.cc:2229] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:51.987814 22072 tablet_replica.cc:330] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: stopping tablet replica
I20260809 15:40:51.987982 22070 raft_consensus.cc:2258] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:51.988191 22072 raft_consensus.cc:2229] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:40:51.988368 22069 tablet_replica.cc:330] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f: stopping tablet replica
I20260809 15:40:51.988596 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 21453
I20260809 15:40:51.988677 22069 raft_consensus.cc:2229] T c9bd73e2ce4a4c5cbc722a05fd723778 P d4b23ad6fbd14549b0268dfcc47fc75f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:51.991145 22072 raft_consensus.cc:2258] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:51.997608 22070 ts_tablet_manager.cc:1905] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:52.000495 22070 ts_tablet_manager.cc:1918] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:40:52.000607 22070 log.cc:1196] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/c9bd73e2ce4a4c5cbc722a05fd723778
I20260809 15:40:52.000980 22070 ts_tablet_manager.cc:1939] T c9bd73e2ce4a4c5cbc722a05fd723778 P df8469a85f224614bf665e3b2c2f9d08: Deleting consensus metadata
I20260809 15:40:52.001929 22072 ts_tablet_manager.cc:1905] T c9bd73e2ce4a4c5cbc722a05fd723778 P 38622b727dd34bdab3665704e0cd76e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:52.002348 21344 catalog_manager.cc:4841] TS df8469a85f224614bf665e3b2c2f9d08 (127.14.15.131:40975): tablet c9bd73e2ce4a4c5cbc722a05fd723778 (table test-table [id=3821c398135e4159a2024f946967eb2f]) successfully deleted
W20260809 15:40:52.003029 21342 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:33829 (error 108)
I20260809 15:40:52.004141 22039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.003822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:33829 (local address 127.0.0.1:35712)
0809 15:40:52.003971 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:52.004043 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:33829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 15:40:52.004279 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 21649
W20260809 15:40:52.007813 21342 catalog_manager.cc:4584] TS d4b23ad6fbd14549b0268dfcc47fc75f (127.14.15.129:33829): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9bd73e2ce4a4c5cbc722a05fd723778: Network error: Client connection negotiation failed: client connection to 127.14.15.129:33829: connect: Connection refused (error 111)
I20260809 15:40:52.019624 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 21838
I20260809 15:40:52.024328 22039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.019800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40953 (local address 127.0.0.1:54056)
0809 15:40:52.024173 (+ 4373us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:52.024246 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.130:40953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4267}
I20260809 15:40:52.031194 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 21319
2026-08-09T15:40:52Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1207 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 15:40:52.059170 14398 mini_oidc.cc:152] Starting JWKS server
I20260809 15:40:52.061075 14398 webserver.cc:460] Webserver started at https://127.0.0.1:42033/ using document root <none> and password file <none>
I20260809 15:40:52.061285 14398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:40:52.061602 14398 webserver.cc:460] Webserver started at http://127.0.0.1:39015/ using document root <none> and password file <none>
2026-08-09T15:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:52Z Disabled control of system clock
I20260809 15:40:52.072474 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33507
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:40279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33507
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42033/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/testchainca.cert with env {}
W20260809 15:40:52.191762 22085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:52.192057 22085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:52.192098 22085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:52.196161 22085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:52.196219 22085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:52.196235 22085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:52.196251 22085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:52.196267 22085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:40:52.196283 22085 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:40:52.196296 22085 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42033/jwks.json
I20260809 15:40:52.201660 22085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33507
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42033/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:52.202674 22085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:52.203606 22085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:52.212044 22094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:52.212056 22097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:52.212182 22085 server_base.cc:1034] running on GCE node
W20260809 15:40:52.212049 22093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:52.212893 22085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:52.213977 22085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:52.215171 22085 hybrid_clock.cc:648] HybridClock initialized: now 1786290052215157 us; error 25 us; skew 500 ppm
I20260809 15:40:52.217031 22085 webserver.cc:460] Webserver started at http://127.14.15.190:46813/ using document root <none> and password file <none>
I20260809 15:40:52.217624 22085 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:52.217721 22085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:52.217969 22085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:52.220141 22085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "d082a184cae54e8b820fdc084ec0fd06"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "c87373e9443aefe721249521549810f1"
server_key_iv: "87e37c09f6c079e4e0d5bb589a1afec5"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.220785 22085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "d082a184cae54e8b820fdc084ec0fd06"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "c87373e9443aefe721249521549810f1"
server_key_iv: "87e37c09f6c079e4e0d5bb589a1afec5"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.224602 22085 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 15:40:52.227021 22103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:52.228197 22085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:52.228343 22085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "d082a184cae54e8b820fdc084ec0fd06"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "c87373e9443aefe721249521549810f1"
server_key_iv: "87e37c09f6c079e4e0d5bb589a1afec5"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.228464 22085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:52.245270 22085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:52.245981 22085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:52.246187 22085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:52.253252 22085 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:33507
I20260809 15:40:52.253258 22180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:33507 every 8 connection(s)
I20260809 15:40:52.254197 22085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:52.257408 22182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:52.259131 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22085
I20260809 15:40:52.259267 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:52.259590 14398 external_mini_cluster.cc:1428] Setting key e25959c36e10c5cd0b0ebf0b7eb23adb
I20260809 15:40:52.264186 22182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: Bootstrap starting.
I20260809 15:40:52.266558 22182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:52.267427 22182 log.cc:824] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:52.269076 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.261130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.14.15.190:33507)
0809 15:40:52.261821 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.261836 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.261871 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:40:52.262604 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.262623 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.263010 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.263354 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:52.263789 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.264795 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.265702 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.266175 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.266404 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.267310 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:52.267315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:52.267327 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:52.267752 (+ 425us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:52.267838 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:52.267865 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:52.267968 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:52.268130 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 15:40:52.268385 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":143,"threads_started":1}
I20260809 15:40:52.269575 22182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: No bootstrap required, opened a new log
I20260809 15:40:52.271927 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:40:52.273620 22182 raft_consensus.cc:348] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } }
I20260809 15:40:52.273881 22182 raft_consensus.cc:374] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:52.273962 22182 raft_consensus.cc:729] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d082a184cae54e8b820fdc084ec0fd06, State: Initialized, Role: FOLLOWER
I20260809 15:40:52.274449 22182 consensus_queue.cc:260] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } }
I20260809 15:40:52.274611 22182 raft_consensus.cc:388] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:52.274701 22182 raft_consensus.cc:482] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:52.274807 22182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:52.275933 22182 raft_consensus.cc:504] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } }
I20260809 15:40:52.276298 22182 leader_election.cc:302] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d082a184cae54e8b820fdc084ec0fd06; no voters:
I20260809 15:40:52.276644 22182 leader_election.cc:288] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:52.276700 22188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:52.276968 22188 raft_consensus.cc:686] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [term 1 LEADER]: Becoming Leader. State: Replica: d082a184cae54e8b820fdc084ec0fd06, State: Running, Role: LEADER
I20260809 15:40:52.277258 22188 consensus_queue.cc:237] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } }
I20260809 15:40:52.277936 22182 sys_catalog.cc:564] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:52.280411 22192 sys_catalog.cc:455] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d082a184cae54e8b820fdc084ec0fd06. Latest consensus state: current_term: 1 leader_uuid: "d082a184cae54e8b820fdc084ec0fd06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } } }
I20260809 15:40:52.281004 22192 sys_catalog.cc:458] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [sys.catalog]: This master's current role is: LEADER
W20260809 15:40:52.284011 22211 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 15:40:52.281092 22189 sys_catalog.cc:455] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d082a184cae54e8b820fdc084ec0fd06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d082a184cae54e8b820fdc084ec0fd06" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33507 } } }
W20260809 15:40:52.284094 22211 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:40:52.284147 22189 sys_catalog.cc:458] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:52.284490 22214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:52.285422 22214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:52.291096 22214 catalog_manager.cc:1347] Generated new cluster ID: 35568b37fac84573b1c605e267aa5d97
I20260809 15:40:52.291167 22214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:52.301405 22214 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:52.302362 22214 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:52.307909 22214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d082a184cae54e8b820fdc084ec0fd06: Generated new TSK 0
I20260809 15:40:52.308604 22214 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 15:40:52.339922 22227 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 15:40:52.340131 22227 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 15:40:52.340708 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.322088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37180 (local address 127.14.15.190:33507)
0809 15:40:52.322276 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.322281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.322496 (+ 215us) server_negotiation.cc:407] Connection header received
0809 15:40:52.322773 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.322777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.322840 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.322959 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:40:52.323270 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.323841 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.325123 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.325391 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.325479 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.325900 (+ 421us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:40:52.340290 (+ 14390us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 15:40:52.340568 (+ 278us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37180: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 15:40:52.340819 22185 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37180: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 15:40:52.342422 22223 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:52.321995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33507 (local address 127.0.0.1:37180)
0809 15:40:52.322396 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:52.322413 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:52.322560 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:52.322993 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:52.322996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:52.323005 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:40:52.323135 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.323142 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.323963 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.323967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.324968 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.324979 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.325526 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.325530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.325624 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.325684 (+ 60us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:40:52.340581 (+ 14897us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 15:40:52.340873 (+ 292us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.15.190:33507: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":136,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.14.15.190:33507: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 15:40:52.343482 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22085
2026-08-09T15:40:52Z chronyd exiting
I20260809 15:40:52.389394 14398 test_util.cc:175] -----------------------------------------------
I20260809 15:40:52.389511 14398 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786290023600843-14398-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (332 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 15:40:52.390782 14398 mini_oidc.cc:152] Starting JWKS server
I20260809 15:40:52.391696 14398 webserver.cc:460] Webserver started at https://127.0.0.1:33187/ using document root <none> and password file <none>
I20260809 15:40:52.391835 14398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:40:52.392119 14398 webserver.cc:460] Webserver started at http://127.0.0.1:40151/ using document root <none> and password file <none>
2026-08-09T15:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:52Z Disabled control of system clock
I20260809 15:40:52.402472 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33439
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:34735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33439
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33187/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/testchainca.cert with env {}
W20260809 15:40:52.517485 22234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:52.517858 22234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:52.517930 22234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:52.522351 22234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:52.522485 22234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:52.522529 22234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:52.522572 22234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:52.522609 22234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:40:52.522650 22234 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:40:52.522681 22234 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33187/jwks.json
I20260809 15:40:52.529235 22234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:34735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33439
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33187/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:52.530483 22234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:52.531736 22234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:52.540486 22244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:52.540478 22242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:52.540474 22241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:52.540618 22234 server_base.cc:1034] running on GCE node
I20260809 15:40:52.541447 22234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:52.542622 22234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:52.543819 22234 hybrid_clock.cc:648] HybridClock initialized: now 1786290052543799 us; error 32 us; skew 500 ppm
I20260809 15:40:52.545634 22234 webserver.cc:460] Webserver started at http://127.14.15.190:42821/ using document root <none> and password file <none>
I20260809 15:40:52.546279 22234 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:52.546375 22234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:52.546624 22234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:52.548658 22234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "8d1ad48c65ed4edb836756f99c0ef8ae"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "e1b6211df4949c397f97103ff2098200"
server_key_iv: "472e7171bfca2669b0e8b55882ad8d42"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.549242 22234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "8d1ad48c65ed4edb836756f99c0ef8ae"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "e1b6211df4949c397f97103ff2098200"
server_key_iv: "472e7171bfca2669b0e8b55882ad8d42"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.552973 22234 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:40:52.555449 22251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:52.556663 22234 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:52.556808 22234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "8d1ad48c65ed4edb836756f99c0ef8ae"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "e1b6211df4949c397f97103ff2098200"
server_key_iv: "472e7171bfca2669b0e8b55882ad8d42"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.556926 22234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:52.583807 22234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:52.584599 22234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:52.584820 22234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:52.592252 22234 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:33439
I20260809 15:40:52.592265 22325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:33439 every 8 connection(s)
I20260809 15:40:52.593288 22234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:52.596642 22326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:52.599212 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22234
I20260809 15:40:52.599351 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:52.599675 14398 external_mini_cluster.cc:1428] Setting key cb9c0b37debeb61355bd3a15d823a82a
I20260809 15:40:52.603233 22326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae: Bootstrap starting.
I20260809 15:40:52.605566 22326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:52.606423 22326 log.cc:824] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:52.608708 22326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae: No bootstrap required, opened a new log
I20260809 15:40:52.609187 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.601192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37084 (local address 127.14.15.190:33439)
0809 15:40:52.601874 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.601889 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.601923 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:40:52.602643 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.602663 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.603062 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.603396 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:52.603852 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.604810 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.605719 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.606202 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.606448 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.607325 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:52.607330 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:52.607344 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:52.607743 (+ 399us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:52.607801 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:52.607822 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:52.607906 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:52.608100 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 15:40:52.608405 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":152,"threads_started":1}
I20260809 15:40:52.612198 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:40:52.612645 22326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } }
I20260809 15:40:52.612955 22326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:52.613020 22326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d1ad48c65ed4edb836756f99c0ef8ae, State: Initialized, Role: FOLLOWER
I20260809 15:40:52.613473 22326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } }
I20260809 15:40:52.613646 22326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:52.613713 22326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:52.613813 22326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:52.614912 22326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } }
I20260809 15:40:52.615231 22326 leader_election.cc:302] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d1ad48c65ed4edb836756f99c0ef8ae; no voters:
I20260809 15:40:52.615530 22326 leader_election.cc:288] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:52.615689 22332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:52.615938 22332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [term 1 LEADER]: Becoming Leader. State: Replica: 8d1ad48c65ed4edb836756f99c0ef8ae, State: Running, Role: LEADER
I20260809 15:40:52.616285 22332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } }
I20260809 15:40:52.616808 22326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:52.617944 22336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d1ad48c65ed4edb836756f99c0ef8ae. Latest consensus state: current_term: 1 leader_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } } }
I20260809 15:40:52.618077 22336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:52.618417 22333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1ad48c65ed4edb836756f99c0ef8ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33439 } } }
I20260809 15:40:52.618507 22345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:52.618533 22333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:52.621999 22345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:52.628113 22345 catalog_manager.cc:1347] Generated new cluster ID: 29de170a1fa6453c8a32fb393539073d
I20260809 15:40:52.628198 22345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:52.640698 22345 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:52.641629 22345 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:52.648705 22345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d1ad48c65ed4edb836756f99c0ef8ae: Generated new TSK 0
I20260809 15:40:52.649432 22345 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 15:40:52.674964 22370 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 15:40:52.675062 22370 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 15:40:52.675863 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.659977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37100 (local address 127.14.15.190:33439)
0809 15:40:52.660125 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.660132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.660226 (+ 94us) server_negotiation.cc:407] Connection header received
0809 15:40:52.660430 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.660433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.660490 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.660605 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:40:52.661002 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.661573 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.662557 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.662797 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.662908 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.663247 (+ 339us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:40:52.675409 (+ 12162us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 15:40:52.675706 (+ 297us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37100: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 15:40:52.675995 22330 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37100: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 15:40:52.676011 22368 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:52.659823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33439 (local address 127.0.0.1:37100)
0809 15:40:52.660120 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:52.660137 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:52.660289 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:52.660612 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:52.660616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:52.660624 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:40:52.660863 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.660876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.661696 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.661702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.662433 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.662442 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.662927 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.662931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.663033 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.663057 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:40:52.675624 (+ 12567us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 15:40:52.675797 (+ 173us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.15.190:33439: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":96,"threads_started":1}
I20260809 15:40:52.676776 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22234
2026-08-09T15:40:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (331 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 15:40:52.722048 14398 mini_oidc.cc:152] Starting JWKS server
I20260809 15:40:52.723043 14398 webserver.cc:460] Webserver started at https://127.0.0.1:41937/ using document root <none> and password file <none>
I20260809 15:40:52.723134 14398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:40:52.723424 14398 webserver.cc:460] Webserver started at http://127.0.0.1:46423/ using document root <none> and password file <none>
2026-08-09T15:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:52Z Disabled control of system clock
I20260809 15:40:52.734287 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46371
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:41883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:46371
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41937/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 15:40:52.851223 22383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:52.851553 22383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:52.851634 22383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:52.855713 22383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:52.855805 22383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:52.855835 22383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:52.855876 22383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:52.855912 22383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:40:52.855950 22383 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:40:52.855983 22383 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41937/jwks.json
I20260809 15:40:52.860996 22383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:46371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41937/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:52.862187 22383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:52.863682 22383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:52.872714 22393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:52.872720 22396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:52.872774 22394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:52.872761 22383 server_base.cc:1034] running on GCE node
I20260809 15:40:52.873663 22383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:52.874892 22383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:52.876101 22383 hybrid_clock.cc:648] HybridClock initialized: now 1786290052876070 us; error 42 us; skew 500 ppm
I20260809 15:40:52.878043 22383 webserver.cc:460] Webserver started at http://127.14.15.190:44287/ using document root <none> and password file <none>
I20260809 15:40:52.878703 22383 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:52.878803 22383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:52.879058 22383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:52.881166 22383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "fec4b9d3dccc486fb7d54d309bba4a4e"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "389ddffc75e1cb4a7c3e21ebc46dc440"
server_key_iv: "5b8dc4d3cf13058e70ad8ec33084ee99"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.881757 22383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "fec4b9d3dccc486fb7d54d309bba4a4e"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "389ddffc75e1cb4a7c3e21ebc46dc440"
server_key_iv: "5b8dc4d3cf13058e70ad8ec33084ee99"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.885754 22383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:52.888451 22403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:52.889789 22383 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 15:40:52.889963 22383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "fec4b9d3dccc486fb7d54d309bba4a4e"
format_stamp: "Formatted at 2026-08-09 15:40:52 on dist-test-slave-jztv"
server_key: "389ddffc75e1cb4a7c3e21ebc46dc440"
server_key_iv: "5b8dc4d3cf13058e70ad8ec33084ee99"
server_key_version: "encryptionkey@0"
I20260809 15:40:52.890112 22383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:52.906634 22383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:52.907401 22383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:52.907621 22383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:52.914486 22383 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:46371
I20260809 15:40:52.914513 22482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:46371 every 8 connection(s)
I20260809 15:40:52.915491 22383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:52.918983 22484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:52.920676 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22383
I20260809 15:40:52.920807 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:52.921118 14398 external_mini_cluster.cc:1428] Setting key 12b7f5d65fcbe16056140bc1ee47ee6a
I20260809 15:40:52.925756 22484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e: Bootstrap starting.
I20260809 15:40:52.928139 22484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:52.929035 22484 log.cc:824] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:52.931234 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.922680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.14.15.190:46371)
0809 15:40:52.923462 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.923479 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.923524 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:40:52.924196 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.924213 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.924666 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.925016 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:52.925466 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.926588 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.927506 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.927991 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.928167 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.929143 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:52.929149 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:52.929184 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:52.929694 (+ 510us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:52.929772 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:52.929803 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:52.929908 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:52.930166 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 15:40:52.930511 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":129,"threads_started":1}
I20260809 15:40:52.931363 22484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e: No bootstrap required, opened a new log
I20260809 15:40:52.934054 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:40:52.935395 22484 raft_consensus.cc:348] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } }
I20260809 15:40:52.935623 22484 raft_consensus.cc:374] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:52.935683 22484 raft_consensus.cc:729] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec4b9d3dccc486fb7d54d309bba4a4e, State: Initialized, Role: FOLLOWER
I20260809 15:40:52.936161 22484 consensus_queue.cc:260] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } }
I20260809 15:40:52.936287 22484 raft_consensus.cc:388] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:52.936372 22484 raft_consensus.cc:482] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:52.936509 22484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:52.937462 22484 raft_consensus.cc:504] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } }
I20260809 15:40:52.937812 22484 leader_election.cc:302] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fec4b9d3dccc486fb7d54d309bba4a4e; no voters:
I20260809 15:40:52.938169 22484 leader_election.cc:288] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:52.938302 22491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:52.938563 22491 raft_consensus.cc:686] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [term 1 LEADER]: Becoming Leader. State: Replica: fec4b9d3dccc486fb7d54d309bba4a4e, State: Running, Role: LEADER
I20260809 15:40:52.938874 22491 consensus_queue.cc:237] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } }
I20260809 15:40:52.939484 22484 sys_catalog.cc:564] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:52.940696 22493 sys_catalog.cc:455] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } } }
I20260809 15:40:52.940699 22494 sys_catalog.cc:455] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fec4b9d3dccc486fb7d54d309bba4a4e. Latest consensus state: current_term: 1 leader_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fec4b9d3dccc486fb7d54d309bba4a4e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46371 } } }
I20260809 15:40:52.940944 22494 sys_catalog.cc:458] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:52.940975 22493 sys_catalog.cc:458] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:52.942030 22504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:52.945350 22504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:52.951329 22504 catalog_manager.cc:1347] Generated new cluster ID: 5ef1fd85ec814c388449221aa2d4e344
I20260809 15:40:52.951432 22504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:52.967463 22504 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:52.968423 22504 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:52.979257 22504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fec4b9d3dccc486fb7d54d309bba4a4e: Generated new TSK 0
I20260809 15:40:52.980100 22504 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:40:53.002972 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:52.995086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.14.15.190:46371)
0809 15:40:52.995207 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:52.995210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:52.995415 (+ 205us) server_negotiation.cc:407] Connection header received
0809 15:40:52.995560 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:52.995563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:52.995625 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:52.995746 (+ 121us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:40:52.995978 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.996820 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.997742 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.998105 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.998229 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.998557 (+ 328us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:40:53.002566 (+ 4009us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41937/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 15:40:53.002817 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50502: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41937/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 15:40:53.003063 22489 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50502: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41937/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 15:40:53.004572 22527 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:52.995009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46371 (local address 127.0.0.1:50502)
0809 15:40:52.995302 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:52.995316 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:52.995422 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:52.995759 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:52.995762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:52.995769 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:40:52.995863 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.995868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.996949 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.996952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.997619 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:52.997627 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:52.998269 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:52.998274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:52.998345 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:52.998369 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:40:53.002759 (+ 4390us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41937/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 15:40:53.004388 (+ 1629us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.15.190:46371: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41937/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":1422,"thread_start_us":127,"threads_started":1}
I20260809 15:40:53.005165 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22383
E20260809 15:40:53.024775 22528 webserver.cc:533] Webserver: sslize failed:
E20260809 15:40:53.024863 22528 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T15:40:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (334 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T15:40:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:53Z Disabled control of system clock
I20260809 15:40:53.067505 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34147
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:33925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34147
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/testchainca.cert with env {}
W20260809 15:40:53.180896 22532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:53.181239 22532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:53.181324 22532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:53.185508 22532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:53.185613 22532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:53.185643 22532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:53.185685 22532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:53.185742 22532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:40:53.185779 22532 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:40:53.185812 22532 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 15:40:53.191534 22532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:33925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34147
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:53.192778 22532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:53.193876 22532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:40:53.202925 22532 server_base.cc:1034] running on GCE node
W20260809 15:40:53.202843 22538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:53.202883 22543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:53.202847 22540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:53.203826 22532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:53.204941 22532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:53.206116 22532 hybrid_clock.cc:648] HybridClock initialized: now 1786290053206100 us; error 25 us; skew 500 ppm
I20260809 15:40:53.208073 22532 webserver.cc:460] Webserver started at http://127.14.15.190:46831/ using document root <none> and password file <none>
I20260809 15:40:53.208668 22532 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:53.208734 22532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:53.208971 22532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:53.211086 22532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "d8ef35194a63474388b22fd589c62342"
format_stamp: "Formatted at 2026-08-09 15:40:53 on dist-test-slave-jztv"
server_key: "744712148b958e7194445388b1ab2e37"
server_key_iv: "496a5141f81c204f5629317210f6d6b4"
server_key_version: "encryptionkey@0"
I20260809 15:40:53.211740 22532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "d8ef35194a63474388b22fd589c62342"
format_stamp: "Formatted at 2026-08-09 15:40:53 on dist-test-slave-jztv"
server_key: "744712148b958e7194445388b1ab2e37"
server_key_iv: "496a5141f81c204f5629317210f6d6b4"
server_key_version: "encryptionkey@0"
I20260809 15:40:53.215463 22532 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:40:53.217857 22549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:53.219105 22532 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:53.219247 22532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "d8ef35194a63474388b22fd589c62342"
format_stamp: "Formatted at 2026-08-09 15:40:53 on dist-test-slave-jztv"
server_key: "744712148b958e7194445388b1ab2e37"
server_key_iv: "496a5141f81c204f5629317210f6d6b4"
server_key_version: "encryptionkey@0"
I20260809 15:40:53.219379 22532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:53.236469 22532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:53.237227 22532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:53.237443 22532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:53.244633 22532 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:34147
I20260809 15:40:53.244661 22623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:34147 every 8 connection(s)
I20260809 15:40:53.245594 22532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:53.248670 22624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:53.253995 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22532
I20260809 15:40:53.254149 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:53.254427 22624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342: Bootstrap starting.
I20260809 15:40:53.254503 14398 external_mini_cluster.cc:1428] Setting key 5e6d383ea1bfa45bbe6e79a29b81041d
I20260809 15:40:53.257120 22624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:53.257865 22624 log.cc:824] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:53.259745 22624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342: No bootstrap required, opened a new log
I20260809 15:40:53.263691 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:53.255797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.14.15.190:34147)
0809 15:40:53.256458 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:53.256499 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:53.256563 (+ 64us) server_negotiation.cc:407] Connection header received
0809 15:40:53.257235 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:53.257262 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:53.257704 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:53.258027 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:53.258487 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.259439 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.260414 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.260883 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.261069 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:53.261950 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:53.261955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:53.261967 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:40:53.262408 (+ 441us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:53.262465 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:40:53.262486 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:53.262603 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:53.262754 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 15:40:53.262999 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":139,"threads_started":1}
I20260809 15:40:53.263579 22624 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } }
I20260809 15:40:53.263836 22624 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:53.263911 22624 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ef35194a63474388b22fd589c62342, State: Initialized, Role: FOLLOWER
I20260809 15:40:53.264389 22624 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } }
I20260809 15:40:53.264549 22624 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:53.264633 22624 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:53.264737 22624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:53.265827 22624 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } }
I20260809 15:40:53.266211 22624 leader_election.cc:302] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8ef35194a63474388b22fd589c62342; no voters:
I20260809 15:40:53.266600 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:40:53.266628 22624 leader_election.cc:288] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:53.266767 22632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:53.267006 22632 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [term 1 LEADER]: Becoming Leader. State: Replica: d8ef35194a63474388b22fd589c62342, State: Running, Role: LEADER
I20260809 15:40:53.267303 22632 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } }
I20260809 15:40:53.267906 22624 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:53.269042 22634 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8ef35194a63474388b22fd589c62342. Latest consensus state: current_term: 1 leader_uuid: "d8ef35194a63474388b22fd589c62342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } } }
I20260809 15:40:53.269181 22634 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:53.269502 22633 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8ef35194a63474388b22fd589c62342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef35194a63474388b22fd589c62342" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34147 } } }
I20260809 15:40:53.269613 22633 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342 [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:53.269698 22644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:53.272717 22644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:53.278193 22644 catalog_manager.cc:1347] Generated new cluster ID: b0fcef50e1f54502b9c65b62ef7b151d
I20260809 15:40:53.278299 22644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:53.284121 22644 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:53.285320 22644 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:53.299746 22644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8ef35194a63474388b22fd589c62342: Generated new TSK 0
I20260809 15:40:53.300690 22644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:40:53.784922 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:53.310210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51150 (local address 127.14.15.190:34147)
0809 15:40:53.310376 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:53.310380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:53.310589 (+ 209us) server_negotiation.cc:407] Connection header received
0809 15:40:53.310769 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:53.310771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:53.310819 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:53.310905 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:40:53.311177 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.311707 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.312964 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.313184 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.313266 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:53.313600 (+ 334us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:40:53.784484 (+470884us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 15:40:53.784790 (+ 306us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51150: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 15:40:53.785046 22628 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51150: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 15:40:53.785575 22663 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:53.310131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34147 (local address 127.0.0.1:51150)
0809 15:40:53.310488 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:53.310503 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:53.310627 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:53.310931 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:53.310934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:53.310943 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:40:53.311061 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:53.311067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.311840 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.311844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:53.312832 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:53.312842 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:53.313307 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:53.313311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:53.313406 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:53.313434 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:40:53.784786 (+471352us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 15:40:53.785059 (+ 273us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.15.190:34147: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":160,"threads_started":1}
I20260809 15:40:53.786199 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22532
2026-08-09T15:40:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (754 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (129 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (125 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:54 dist-test-slave-jztv krb5kdc[22685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:54 dist-test-slave-jztv krb5kdc[22685](info): set up 2 sockets
Aug 09 15:40:54 dist-test-slave-jztv krb5kdc[22685](info): commencing operation
krb5kdc: starting...
W20260809 15:40:55.285315 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:55 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:40:55.425789 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42669
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:42669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:55.541414 22702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:55.541738 22702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:55.541819 22702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:55.545873 22702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:55.545972 22702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:55.546012 22702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:55.546067 22702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:55.546116 22702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:55.551471 22702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:42669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:55.552560 22702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:55.553592 22702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:55.562379 22712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:55.562444 22714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:55.562379 22711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:55.562744 22702 server_base.cc:1034] running on GCE node
I20260809 15:40:55.563388 22702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:55.564432 22702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:55.565616 22702 hybrid_clock.cc:648] HybridClock initialized: now 1786290055565581 us; error 41 us; skew 500 ppm
Aug 09 15:40:55 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290055, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:55.569271 22702 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:40:55.570173 22702 webserver.cc:460] Webserver started at http://127.14.15.190:38213/ using document root <none> and password file <none>
I20260809 15:40:55.570815 22702 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:55.570924 22702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:55.571202 22702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:55.574020 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "ca663c805e3247ecbb902677b491955c"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "2ce7c0d45578700ae7256accf2560698"
server_key_iv: "e768e76b63062eead5efd129d5a0ebbd"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.574664 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "ca663c805e3247ecbb902677b491955c"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "2ce7c0d45578700ae7256accf2560698"
server_key_iv: "e768e76b63062eead5efd129d5a0ebbd"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.579207 22702 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:40:55.582656 22726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:55.584463 22702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:40:55.584642 22702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "ca663c805e3247ecbb902677b491955c"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "2ce7c0d45578700ae7256accf2560698"
server_key_iv: "e768e76b63062eead5efd129d5a0ebbd"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.584836 22702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:55.627370 22702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:55.631047 22702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:55.631259 22702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:55.638734 22702 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:42669
I20260809 15:40:55.639060 22799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:42669 every 8 connection(s)
I20260809 15:40:55.639871 22702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:55.643148 22800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:55.644389 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22702
I20260809 15:40:55.644531 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:55.644881 14398 external_mini_cluster.cc:1428] Setting key 06cdeafe7f525a20cd0f40e6d87c2cb2
I20260809 15:40:55.649626 22800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: Bootstrap starting.
I20260809 15:40:55.652002 22800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:55.652782 22800 log.cc:824] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:40:55 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:55.655040 22800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: No bootstrap required, opened a new log
I20260809 15:40:55.658614 22800 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } }
I20260809 15:40:55.658915 22800 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:55.659000 22800 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca663c805e3247ecbb902677b491955c, State: Initialized, Role: FOLLOWER
I20260809 15:40:55.659559 22800 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } }
I20260809 15:40:55.659720 22800 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:55.659729 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:55.646442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.14.15.190:42669)
0809 15:40:55.646919 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:55.646934 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:55.646970 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:55.647613 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:55.647631 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:55.647971 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:55.648333 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:55.649199 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.650313 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.651190 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.651670 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.651853 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:55.654777 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:55.654782 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:55.654795 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:55.654823 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:55.656594 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:55.657080 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:55.657089 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:55.657099 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:55.657211 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:55.657507 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:55.657510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:55.657512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:55.657909 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:55.658123 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:55.658436 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 15:40:55.658731 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":157,"threads_started":1}
I20260809 15:40:55.659827 22800 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:55.659940 22800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:55.661139 22800 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } }
I20260809 15:40:55.661492 22800 leader_election.cc:302] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca663c805e3247ecbb902677b491955c; no voters:
I20260809 15:40:55.661808 22800 leader_election.cc:288] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:55.661938 22807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:55.662196 22807 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [term 1 LEADER]: Becoming Leader. State: Replica: ca663c805e3247ecbb902677b491955c, State: Running, Role: LEADER
I20260809 15:40:55.662533 22807 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } }
I20260809 15:40:55.663071 22800 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:55.663690 22807 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca663c805e3247ecbb902677b491955c. Latest consensus state: current_term: 1 leader_uuid: "ca663c805e3247ecbb902677b491955c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } } }
I20260809 15:40:55.663806 22807 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:55.664238 22810 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca663c805e3247ecbb902677b491955c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca663c805e3247ecbb902677b491955c" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42669 } } }
I20260809 15:40:55.664347 22810 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c [sys.catalog]: This master's current role is: LEADER
W20260809 15:40:55.668187 22829 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:40:55.668282 22829 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:40:55.668359 22816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:55.669265 22816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:55.674978 22816 catalog_manager.cc:1347] Generated new cluster ID: a8552da0cba74767baf5f006993f85f0
I20260809 15:40:55.675060 22816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:55.685683 22816 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:55.686745 22816 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:55.691421 22816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca663c805e3247ecbb902677b491955c: Generated new TSK 0
I20260809 15:40:55.692095 22816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:40:55.724802 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:55.841399 22839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:55.841662 22839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:55.841706 22839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:55.845731 22839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:55.845793 22839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:55.845878 22839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:55.851866 22839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:55.852959 22839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:55.853997 22839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:55.863549 22851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:55.863549 22846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:55.863566 22848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:55.864135 22839 server_base.cc:1034] running on GCE node
I20260809 15:40:55.864552 22839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:55.865243 22839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:55.866432 22839 hybrid_clock.cc:648] HybridClock initialized: now 1786290055866411 us; error 37 us; skew 500 ppm
Aug 09 15:40:55 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290055, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:55.869143 22839 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:40:55.870029 22839 webserver.cc:460] Webserver started at http://127.14.15.129:39439/ using document root <none> and password file <none>
I20260809 15:40:55.870622 22839 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:55.870685 22839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:55.870857 22839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:55.872865 22839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "042617e45e6947eab10e1b238c237828"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "0590ab016a77aaa671a5f93d3e9c6d0e"
server_key_iv: "d6c2ee30f18c23fcc522ecf328185bac"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.873371 22839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "042617e45e6947eab10e1b238c237828"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "0590ab016a77aaa671a5f93d3e9c6d0e"
server_key_iv: "d6c2ee30f18c23fcc522ecf328185bac"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.877025 22839 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:40:55.879724 22871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:55.880918 22839 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:55.881042 22839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "042617e45e6947eab10e1b238c237828"
format_stamp: "Formatted at 2026-08-09 15:40:55 on dist-test-slave-jztv"
server_key: "0590ab016a77aaa671a5f93d3e9c6d0e"
server_key_iv: "d6c2ee30f18c23fcc522ecf328185bac"
server_key_version: "encryptionkey@0"
I20260809 15:40:55.881151 22839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:55.896466 22839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:55.899451 22839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:55.899652 22839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:55.900240 22839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:55.901072 22839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:55.901121 22839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:55.901199 22839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:55.901232 22839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:55.910336 22839 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:36069
I20260809 15:40:55.910354 23035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:36069 every 8 connection(s)
I20260809 15:40:55.911247 22839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:55.912197 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 22839
I20260809 15:40:55.912317 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:55.912657 14398 external_mini_cluster.cc:1428] Setting key 2fba812b405d808c5b8fd31714b64724
Aug 09 15:40:55 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290055, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:55.925916 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:55.913232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:40993 (local address 127.14.15.190:42669)
0809 15:40:55.913380 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:55.913384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:55.914385 (+ 1001us) server_negotiation.cc:407] Connection header received
0809 15:40:55.915749 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:55.915755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:55.915820 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:55.915914 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:55.917508 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.918026 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.919171 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.919654 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.919785 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:55.922202 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:55.922207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:55.922210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:55.922273 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:55.923977 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:55.924554 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:55.924558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:55.924560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:55.924659 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:55.924967 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:55.924969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:55.924971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:55.925163 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:55.925242 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:55.925684 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 15:40:55.925790 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:40:55.926775 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:55.913670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42669 (local address 127.14.15.129:40993)
0809 15:40:55.914189 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:55.914275 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:55.915533 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:55.916118 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:55.916129 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:55.916652 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:55.917345 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:55.917370 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.918137 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.918140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:55.919038 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:55.919048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:55.919845 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:55.919849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:55.919998 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:55.920603 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:55.920620 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:55.922025 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:55.924130 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:55.924135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:55.924147 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:55.924442 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:55.924755 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:55.924757 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:55.924758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:55.924887 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:55.925250 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:55.925255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:55.925480 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 15:40:55.925638 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 15:40:55.925880 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":157,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:55.928119 23037 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42669
I20260809 15:40:55.928377 23037 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:55.928965 23037 heartbeater.cc:511] Master 127.14.15.190:42669 requested a full tablet report, sending...
I20260809 15:40:55.930552 22749 ts_manager.cc:194] Registered new tserver with Master: 042617e45e6947eab10e1b238c237828 (127.14.15.129:36069)
I20260809 15:40:55.931658 22749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:40993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:40:55.943121 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:56.056135 23046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:56.056416 23046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:56.056459 23046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:56.060806 23046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:56.060868 23046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:56.060927 23046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:56.066425 23046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:56.067519 23046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:56.068509 23046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:56.078444 23051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:56.078459 23053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:56.078462 23055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:56.078789 23046 server_base.cc:1034] running on GCE node
I20260809 15:40:56.079213 23046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:56.079859 23046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:56.081046 23046 hybrid_clock.cc:648] HybridClock initialized: now 1786290056081031 us; error 32 us; skew 500 ppm
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.083967 23046 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:40:56.084918 23046 webserver.cc:460] Webserver started at http://127.14.15.130:44777/ using document root <none> and password file <none>
I20260809 15:40:56.085634 23046 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:56.085732 23046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:56.085958 23046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:56.088104 23046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "c9634ca105a3460c89b28a49d1d305ca"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "e39ca37e02b85f9d52e7b0156feb462b"
server_key_iv: "a311c22d5095db0c3ce13959eda0e2a9"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.088719 23046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "c9634ca105a3460c89b28a49d1d305ca"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "e39ca37e02b85f9d52e7b0156feb462b"
server_key_iv: "a311c22d5095db0c3ce13959eda0e2a9"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.092696 23046 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:40:56.095299 23062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.096611 23046 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:56.096747 23046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "c9634ca105a3460c89b28a49d1d305ca"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "e39ca37e02b85f9d52e7b0156feb462b"
server_key_iv: "a311c22d5095db0c3ce13959eda0e2a9"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.096866 23046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:56.117045 23046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:56.120496 23046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:56.120709 23046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:56.121336 23046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:56.122195 23046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:56.122329 23046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.122416 23046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:56.122462 23046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.131372 23046 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:42605
I20260809 15:40:56.131398 23228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:42605 every 8 connection(s)
I20260809 15:40:56.132311 23046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:56.140223 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 23046
I20260809 15:40:56.140333 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:56.140728 14398 external_mini_cluster.cc:1428] Setting key c9b68954289275b778cd9a3f45c16c01
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:56.146205 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.134155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:40463 (local address 127.14.15.190:42669)
0809 15:40:56.134329 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.134334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.135269 (+ 935us) server_negotiation.cc:407] Connection header received
0809 15:40:56.136624 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.136627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.136677 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.136760 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.137960 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.138526 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.139622 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.139824 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.139900 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.142651 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:56.142654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:56.142656 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:56.142681 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:56.144149 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.144673 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.144676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.144678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.144763 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.145110 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.145114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.145116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.145304 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:56.145408 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:56.145907 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 15:40:56.146041 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 15:40:56.147079 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.134635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42669 (local address 127.14.15.130:40463)
0809 15:40:56.135106 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:56.135153 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:56.136410 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:56.136931 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:56.136938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:56.137308 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:56.137817 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:56.137830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.138641 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.138643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:56.139516 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:56.139525 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.139949 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.139951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:56.140090 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.140783 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:56.140809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:56.142471 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:56.144273 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:56.144279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:56.144295 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:56.144566 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:56.144854 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:56.144858 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:56.144860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:56.145013 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:56.145410 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:56.145419 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:56.145669 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 15:40:56.145862 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:40:56.146205 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":115,"threads_started":1}
I20260809 15:40:56.148293 23229 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42669
I20260809 15:40:56.148540 23229 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:56.149050 23229 heartbeater.cc:511] Master 127.14.15.190:42669 requested a full tablet report, sending...
I20260809 15:40:56.150141 22749 ts_manager.cc:194] Registered new tserver with Master: c9634ca105a3460c89b28a49d1d305ca (127.14.15.130:42605)
I20260809 15:40:56.150776 22749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:40463
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:40:56.169461 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:56.286295 23239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:56.286554 23239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:56.286603 23239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:56.290725 23239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:56.290779 23239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:56.290838 23239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:56.296136 23239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:56.297130 23239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:56.298125 23239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:56.307909 23250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:56.307943 23246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:56.307973 23247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:56.308296 23239 server_base.cc:1034] running on GCE node
I20260809 15:40:56.308709 23239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:56.309373 23239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:56.310563 23239 hybrid_clock.cc:648] HybridClock initialized: now 1786290056310540 us; error 31 us; skew 500 ppm
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.313446 23239 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:40:56.314415 23239 webserver.cc:460] Webserver started at http://127.14.15.131:38105/ using document root <none> and password file <none>
I20260809 15:40:56.314960 23239 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:56.315017 23239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:56.315186 23239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:56.317294 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "0dc17ce13e3a4e00a6e1bc82cd40008a"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "4e2b1d3af31c77cbc2bef26ea51f6a09"
server_key_iv: "7e8b6319e7e4f54e41a9eb1117d7e94b"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.317821 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "0dc17ce13e3a4e00a6e1bc82cd40008a"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "4e2b1d3af31c77cbc2bef26ea51f6a09"
server_key_iv: "7e8b6319e7e4f54e41a9eb1117d7e94b"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.321535 23239 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:40:56.324200 23258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.325385 23239 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:56.325557 23239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "0dc17ce13e3a4e00a6e1bc82cd40008a"
format_stamp: "Formatted at 2026-08-09 15:40:56 on dist-test-slave-jztv"
server_key: "4e2b1d3af31c77cbc2bef26ea51f6a09"
server_key_iv: "7e8b6319e7e4f54e41a9eb1117d7e94b"
server_key_version: "encryptionkey@0"
I20260809 15:40:56.325668 23239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:56.348477 23239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:56.351930 23239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:56.352146 23239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:56.352778 23239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:56.353637 23239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:56.353685 23239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.353751 23239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:56.353789 23239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:56.363075 23239 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:37725
I20260809 15:40:56.363127 23420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:37725 every 8 connection(s)
I20260809 15:40:56.364077 23239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:56.366813 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 23239
I20260809 15:40:56.366940 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:40:56.367285 14398 external_mini_cluster.cc:1428] Setting key 64013710d9365de1e894d8448f354023
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:40:56.377787 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.366030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:48481 (local address 127.14.15.190:42669)
0809 15:40:56.366171 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.366175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.367122 (+ 947us) server_negotiation.cc:407] Connection header received
0809 15:40:56.368564 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.368568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.368623 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.368703 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.369842 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.370434 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.371592 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.371807 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.371915 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.374375 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:56.374379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:56.374381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:56.374411 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:56.375813 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.376312 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.376317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.376319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.376406 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.376735 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.376739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.376741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.376923 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:56.377024 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:56.377505 (+ 481us) server_negotiation.cc:299] Negotiation successful
0809 15:40:56.377623 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:40:56.378656 23424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.366467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42669 (local address 127.14.15.131:48481)
0809 15:40:56.366954 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:56.367006 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:56.368367 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:56.368870 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:56.368877 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:56.369230 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:56.369704 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:56.369717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.370553 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.370557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:56.371470 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:56.371480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.371960 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.371965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:56.372124 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.372719 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:56.372735 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:56.374173 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:56.375939 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:56.375945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:56.375960 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:56.376211 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:56.376495 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:56.376499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:56.376501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:56.376641 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:56.377024 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:56.377032 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:56.377276 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 15:40:56.377460 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 15:40:56.377779 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":137,"threads_started":1}
I20260809 15:40:56.379766 23422 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42669
I20260809 15:40:56.380041 23422 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:56.380677 23422 heartbeater.cc:511] Master 127.14.15.190:42669 requested a full tablet report, sending...
I20260809 15:40:56.381857 22749 ts_manager.cc:194] Registered new tserver with Master: 0dc17ce13e3a4e00a6e1bc82cd40008a (127.14.15.131:37725)
I20260809 15:40:56.382542 22749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:48481
I20260809 15:40:56.393288 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/test-admin.keytab.
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.410894 14398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 15:40:56.413856 14398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc' of type FILE
W20260809 15:40:56.413863 23430 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:56.412347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51850 (local address 127.14.15.129:36069)
0809 15:40:56.412700 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.412715 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.412744 (+ 29us) server_negotiation.cc:407] Connection header received
0809 15:40:56.412798 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.412804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.413006 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.413147 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.413665 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51850: BlockingRecv error: recv got EOF from 127.0.0.1:51850 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":144,"threads_started":1}
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.415127 14398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.416036 14398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:56.425518 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.416915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.14.15.129:36069)
0809 15:40:56.417042 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.417048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.417153 (+ 105us) server_negotiation.cc:407] Connection header received
0809 15:40:56.417268 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.417271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.417311 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.417374 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.417856 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.418713 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.419542 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.419919 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.420002 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.422329 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:56.422338 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:56.422353 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:56.422378 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:56.423854 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.424259 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.424264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.424265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.424342 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.424567 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.424569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.424570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.424808 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:56.424957 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:56.425177 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 15:40:56.425361 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 15:40:56.429575 23430 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:56.428355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51862 (local address 127.14.15.129:36069)
0809 15:40:56.428486 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.428509 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.428596 (+ 87us) server_negotiation.cc:407] Connection header received
0809 15:40:56.428754 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.428757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.428794 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.428870 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.429454 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51862: BlockingRecv error: recv got EOF from 127.0.0.1:51862 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 15:40:56.429699 14398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc' of type FILE
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.430840 14398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.431741 14398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:56.440199 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.432566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51872 (local address 127.14.15.129:36069)
0809 15:40:56.432693 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.432697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.432833 (+ 136us) server_negotiation.cc:407] Connection header received
0809 15:40:56.432921 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.432923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.432959 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.433034 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.433508 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.434014 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.434896 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.435163 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.435263 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.437309 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:56.437312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:56.437314 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:56.437336 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:56.438727 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.439089 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.439092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.439093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.439167 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.439418 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.439420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.439421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.439598 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:56.439696 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:56.439891 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 15:40:56.440024 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 15:40:56.443010 23430 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:40:56.441936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51880 (local address 127.14.15.129:36069)
0809 15:40:56.442061 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.442065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.442171 (+ 106us) server_negotiation.cc:407] Connection header received
0809 15:40:56.442372 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.442375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.442418 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.442503 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.442894 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51880: BlockingRecv error: recv got EOF from 127.0.0.1:51880 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 15:40:56.443158 14398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786290023600843-14398-0/krb5kdc/krb5cc' of type FILE
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.444123 14398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:56.444954 14398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[22685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:40:56.453069 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:56.445710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51886 (local address 127.14.15.129:36069)
0809 15:40:56.445847 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:56.445851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:56.445921 (+ 70us) server_negotiation.cc:407] Connection header received
0809 15:40:56.446005 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:56.446007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:56.446040 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:56.446105 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:56.446672 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.447144 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.447912 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:56.448108 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:56.448178 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:56.450306 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:56.450309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:56.450311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:56.450333 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:56.451675 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.452057 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.452059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.452060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.452130 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:56.452355 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:56.452357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:56.452358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:56.452505 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:56.452608 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:56.452780 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 15:40:56.452863 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:40:56.454061 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22839
I20260809 15:40:56.467783 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 23046
I20260809 15:40:56.481462 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 23239
I20260809 15:40:56.492141 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 22702
2026-08-09T15:40:56Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2452 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[23451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[23451](info): set up 2 sockets
Aug 09 15:40:56 dist-test-slave-jztv krb5kdc[23451](info): commencing operation
krb5kdc: starting...
W20260809 15:40:57.721148 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:40:57 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:40:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab.
Entry for principal oryx/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab.
I20260809 15:40:57.852962 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39441
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab
--principal=oryx/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:57.968676 23472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:57.969013 23472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:57.969092 23472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:57.973215 23472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:57.973310 23472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:57.973351 23472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:57.973407 23472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:57.973452 23472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:57.978971 23472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab
--principal=oryx/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:57.980122 23472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:57.981186 23472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:57.989804 23480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:57.989818 23481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:57.989810 23483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:57.990103 23472 server_base.cc:1034] running on GCE node
I20260809 15:40:57.990797 23472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:57.991979 23472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:57.993191 23472 hybrid_clock.cc:648] HybridClock initialized: now 1786290057993177 us; error 30 us; skew 500 ppm
Aug 09 15:40:57 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:57.996061 23472 init.cc:377] Logged in from keytab as oryx/127.14.15.190@KRBTEST.COM (short username oryx)
I20260809 15:40:57.997035 23472 webserver.cc:460] Webserver started at http://127.14.15.190:34201/ using document root <none> and password file <none>
I20260809 15:40:57.997629 23472 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:57.997723 23472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:57.997959 23472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:58.000211 23472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "931362268fa64fb382652b560da8480f"
format_stamp: "Formatted at 2026-08-09 15:40:57 on dist-test-slave-jztv"
server_key: "84ca6f183a5a1520a9a2d2b39d0c991a"
server_key_iv: "03fe39d33e6871de1dc71e87cdb8a84e"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.000810 23472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "931362268fa64fb382652b560da8480f"
format_stamp: "Formatted at 2026-08-09 15:40:57 on dist-test-slave-jztv"
server_key: "84ca6f183a5a1520a9a2d2b39d0c991a"
server_key_iv: "03fe39d33e6871de1dc71e87cdb8a84e"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.004783 23472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:40:58.007351 23493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.008565 23472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:58.008713 23472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "931362268fa64fb382652b560da8480f"
format_stamp: "Formatted at 2026-08-09 15:40:57 on dist-test-slave-jztv"
server_key: "84ca6f183a5a1520a9a2d2b39d0c991a"
server_key_iv: "03fe39d33e6871de1dc71e87cdb8a84e"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.008831 23472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:58.035517 23472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:58.039124 23472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:58.039394 23472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:58.047104 23472 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39441
I20260809 15:40:58.047420 23578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39441 every 8 connection(s)
I20260809 15:40:58.048175 23472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:40:58.050419 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 23472
I20260809 15:40:58.050565 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:40:58.050865 14398 external_mini_cluster.cc:1428] Setting key aee0453210703f0a8388f899b726b330
I20260809 15:40:58.051324 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:58.058353 23580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Bootstrap starting.
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:40:58.061275 23580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:58.062062 23580 log.cc:824] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:58.064517 23580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: No bootstrap required, opened a new log
I20260809 15:40:58.066361 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.052344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45720 (local address 127.14.15.190:39441)
0809 15:40:58.052760 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:58.052777 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:58.052813 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:40:58.053470 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:58.053487 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:58.053802 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:58.054079 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:58.055050 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.056071 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.057272 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.057736 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.057857 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.061155 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:58.061161 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:58.061174 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:58.061205 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:58.063292 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.063843 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.063847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.063852 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.063962 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.064253 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.064255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.064257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.064692 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:58.064846 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:58.065234 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 15:40:58.065559 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":140,"threads_started":1}
I20260809 15:40:58.069128 23580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } }
I20260809 15:40:58.069386 23580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:58.069475 23580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931362268fa64fb382652b560da8480f, State: Initialized, Role: FOLLOWER
I20260809 15:40:58.069895 23580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } }
I20260809 15:40:58.070047 23580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:40:58.070138 23580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:40:58.070272 23580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:58.071260 23580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } }
I20260809 15:40:58.071614 23580 leader_election.cc:302] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931362268fa64fb382652b560da8480f; no voters:
I20260809 15:40:58.071950 23580 leader_election.cc:288] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:40:58.072098 23585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:40:58.072381 23585 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 LEADER]: Becoming Leader. State: Replica: 931362268fa64fb382652b560da8480f, State: Running, Role: LEADER
I20260809 15:40:58.072707 23585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } }
I20260809 15:40:58.073192 23580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:58.074347 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } }
I20260809 15:40:58.074594 23587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931362268fa64fb382652b560da8480f. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } }
I20260809 15:40:58.074708 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:58.074787 23587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:58.075235 23603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:40:58.078159 23603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:40:58.083269 23603 catalog_manager.cc:1347] Generated new cluster ID: 0c33b6f09d504a0997934c9cff1146a4
I20260809 15:40:58.083333 23603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:40:58.136148 23603 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:40:58.137161 23603 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:40:58.143028 23603 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Generated new TSK 0
I20260809 15:40:58.143765 23603 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
I20260809 15:40:58.186852 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:58.303579 23614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:58.303826 23614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:58.303869 23614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:58.308007 23614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:58.308060 23614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:58.308117 23614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:58.313434 23614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:58.314522 23614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:58.315555 23614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:58.325484 23628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.325562 23624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.325562 23625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:58.325778 23614 server_base.cc:1034] running on GCE node
I20260809 15:40:58.326179 23614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:58.326841 23614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:58.328034 23614 hybrid_clock.cc:648] HybridClock initialized: now 1786290058328020 us; error 35 us; skew 500 ppm
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:58.330869 23614 init.cc:377] Logged in from keytab as oryx/127.14.15.129@KRBTEST.COM (short username oryx)
I20260809 15:40:58.331833 23614 webserver.cc:460] Webserver started at http://127.14.15.129:42857/ using document root <none> and password file <none>
I20260809 15:40:58.332418 23614 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:58.332508 23614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:58.332746 23614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:58.334888 23614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "bad54bf5e19a444fb3fa48cebf2b4851"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "d92170ca90ab714908ca76b257fe21d6"
server_key_iv: "ded510d3c8147aa5d76a577d17c91604"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.335461 23614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "bad54bf5e19a444fb3fa48cebf2b4851"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "d92170ca90ab714908ca76b257fe21d6"
server_key_iv: "ded510d3c8147aa5d76a577d17c91604"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.339167 23614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:40:58.341580 23641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.342870 23614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:58.343029 23614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "bad54bf5e19a444fb3fa48cebf2b4851"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "d92170ca90ab714908ca76b257fe21d6"
server_key_iv: "ded510d3c8147aa5d76a577d17c91604"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.343146 23614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:58.356606 23614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:58.359916 23614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:58.360122 23614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:58.360713 23614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:58.361539 23614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:58.361608 23614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.361677 23614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:58.361717 23614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.370721 23614 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:40209
I20260809 15:40:58.370751 23803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:40209 every 8 connection(s)
I20260809 15:40:58.371592 23614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:58.374434 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 23614
I20260809 15:40:58.374591 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:40:58.374898 14398 external_mini_cluster.cc:1428] Setting key f30b5ae0ba815b6322e05c987dd40bfc
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:40:58.387277 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.373267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:43935 (local address 127.14.15.190:39441)
0809 15:40:58.373404 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:58.373409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:58.374370 (+ 961us) server_negotiation.cc:407] Connection header received
0809 15:40:58.376039 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:58.376042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:58.376111 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:58.376210 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:58.377572 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.378468 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.380196 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.380619 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.380746 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.383598 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:58.383602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:58.383604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:58.383629 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:58.385014 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.385649 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.385652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.385653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.385727 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.386103 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.386105 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.386106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.386351 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:58.386432 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:58.387004 (+ 572us) server_negotiation.cc:299] Negotiation successful
0809 15:40:58.387142 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:40:58.387954 23807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.373612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:43935)
0809 15:40:58.374143 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:58.374198 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:58.375827 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:58.376390 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:58.376397 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:58.376760 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:58.377384 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.377408 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.378618 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.378625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.380065 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.380075 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.380761 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.380764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.380900 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.381535 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:58.381550 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:58.383421 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:58.385135 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.385141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.385158 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.385528 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.385817 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.385821 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.385823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.386001 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.386464 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:58.386473 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:58.386758 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 15:40:58.386920 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 15:40:58.387169 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.130@KRBTEST.COM" created.
I20260809 15:40:58.389307 23804 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:40:58.389554 23804 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:58.390043 23804 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
I20260809 15:40:58.391762 23520 ts_manager.cc:194] Registered new tserver with Master: bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209)
I20260809 15:40:58.393095 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:43935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
I20260809 15:40:58.406836 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:58.519448 23813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:58.519750 23813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:58.519820 23813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:58.523908 23813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:58.523991 23813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:58.524084 23813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:58.529320 23813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:58.530444 23813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:58.531497 23813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:58.541325 23822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.541332 23821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.541326 23826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:58.542004 23813 server_base.cc:1034] running on GCE node
I20260809 15:40:58.542459 23813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:58.543084 23813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:58.544239 23813 hybrid_clock.cc:648] HybridClock initialized: now 1786290058544206 us; error 46 us; skew 500 ppm
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:58.546950 23813 init.cc:377] Logged in from keytab as oryx/127.14.15.130@KRBTEST.COM (short username oryx)
I20260809 15:40:58.547870 23813 webserver.cc:460] Webserver started at http://127.14.15.130:33727/ using document root <none> and password file <none>
I20260809 15:40:58.548439 23813 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:58.548501 23813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:58.548764 23813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:58.550921 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "286f0962394b4fa89f88f74f812948f8"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "c3afe534edda8ede99fa9fdd0d8a892b"
server_key_iv: "3badb87485493bd2c3b5d160c0610754"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.551491 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "286f0962394b4fa89f88f74f812948f8"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "c3afe534edda8ede99fa9fdd0d8a892b"
server_key_iv: "3badb87485493bd2c3b5d160c0610754"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.555200 23813 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:40:58.557511 23834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.558718 23813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:58.558846 23813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "286f0962394b4fa89f88f74f812948f8"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "c3afe534edda8ede99fa9fdd0d8a892b"
server_key_iv: "3badb87485493bd2c3b5d160c0610754"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.558951 23813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:58.575212 23813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:58.577993 23813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:58.578181 23813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:58.578801 23813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:58.579670 23813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:58.579717 23813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.579782 23813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:58.579816 23813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.588819 23813 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:42491
I20260809 15:40:58.588848 23999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:42491 every 8 connection(s)
I20260809 15:40:58.589692 23813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:58.593964 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 23813
I20260809 15:40:58.594054 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:40:58.594422 14398 external_mini_cluster.cc:1428] Setting key e985cf1ec7f0a4f4b3d0b5f727a0a301
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:40:58.604826 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.591431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:33245 (local address 127.14.15.190:39441)
0809 15:40:58.591557 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:58.591566 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:58.592327 (+ 761us) server_negotiation.cc:407] Connection header received
0809 15:40:58.593708 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:58.593712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:58.593776 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:58.593857 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:58.595236 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.595841 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.597520 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.597755 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.597875 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.600716 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:58.600724 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:58.600730 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:58.600765 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:58.602635 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.603156 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.603162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.603166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.603271 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.603606 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.603612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.603614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.603873 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:58.603992 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:58.604482 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 15:40:58.604618 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:40:58.605583 24002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.591753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:33245)
0809 15:40:58.592190 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:58.592231 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:58.593488 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:58.594042 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:58.594052 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:58.594565 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:58.595061 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.595075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.595961 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.595965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.597376 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.597394 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.597943 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.597949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.598186 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.598858 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:58.598875 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:58.600536 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:58.602757 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.602761 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.602774 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.603037 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.603362 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.603365 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.603366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.603506 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.603983 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:58.603987 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:58.604230 (+ 243us) client_negotiation.cc:769] Sending connection context
0809 15:40:58.604387 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 15:40:58.604655 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":127,"threads_started":1}
WARNING: no policy specified for oryx/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:40:58.606902 24000 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:40:58.607190 24000 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:58.607744 24000 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.131@KRBTEST.COM" created.
I20260809 15:40:58.608946 23520 ts_manager.cc:194] Registered new tserver with Master: 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:40:58.609754 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:33245
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
I20260809 15:40:58.626346 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:58.740690 24006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:58.740952 24006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:58.741048 24006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:58.745047 24006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:58.745126 24006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:58.745217 24006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:40:58.750481 24006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:58.751499 24006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:58.752481 24006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:58.762039 24013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.762030 24015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.762033 24012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:58.762107 24006 server_base.cc:1034] running on GCE node
I20260809 15:40:58.762706 24006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:58.763337 24006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:58.764521 24006 hybrid_clock.cc:648] HybridClock initialized: now 1786290058764504 us; error 32 us; skew 500 ppm
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:58.767452 24006 init.cc:377] Logged in from keytab as oryx/127.14.15.131@KRBTEST.COM (short username oryx)
I20260809 15:40:58.768289 24006 webserver.cc:460] Webserver started at http://127.14.15.131:40143/ using document root <none> and password file <none>
I20260809 15:40:58.768801 24006 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:58.768860 24006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:58.769220 24006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:58.771312 24006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "15385e6d58494bb79f7b060b0ca2ef77"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "1ebdd998030f9cdfcef8afef21cdfe89"
server_key_iv: "eb79d9862f8bf0f9a1d5f6e990f90e93"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.771835 24006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "15385e6d58494bb79f7b060b0ca2ef77"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "1ebdd998030f9cdfcef8afef21cdfe89"
server_key_iv: "eb79d9862f8bf0f9a1d5f6e990f90e93"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.775677 24006 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:58.778002 24026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.779206 24006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:58.779312 24006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "15385e6d58494bb79f7b060b0ca2ef77"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "1ebdd998030f9cdfcef8afef21cdfe89"
server_key_iv: "eb79d9862f8bf0f9a1d5f6e990f90e93"
server_key_version: "encryptionkey@0"
I20260809 15:40:58.779419 24006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:58.789417 24006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:58.792022 24006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:58.792208 24006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:58.792745 24006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:58.793524 24006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:58.793592 24006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.793659 24006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:58.793705 24006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:58.802714 24006 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45993
I20260809 15:40:58.802743 24187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45993 every 8 connection(s)
I20260809 15:40:58.803663 24006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:40:58.813509 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 24006
I20260809 15:40:58.813639 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:40:58.813969 14398 external_mini_cluster.cc:1428] Setting key 3497f3b22925b6f5e4d285c50be7d4a3
I20260809 15:40:58.818001 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.805464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:48043 (local address 127.14.15.190:39441)
0809 15:40:58.805616 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:58.805621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:58.806513 (+ 892us) server_negotiation.cc:407] Connection header received
0809 15:40:58.807821 (+ 1308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:58.807824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:58.807872 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:58.807954 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:58.809304 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.810029 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.811568 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.811933 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.812023 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.814559 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:58.814562 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:58.814564 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:58.814590 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:58.816100 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.816661 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.816664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.816666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.816746 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:58.817066 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:58.817069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:58.817070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:58.817248 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:58.817321 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:58.817775 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 15:40:58.817881 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:40:58.818867 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:58.805870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:48043)
0809 15:40:58.806365 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:58.806415 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:58.807618 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:58.808082 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:58.808088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:58.808449 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:58.809130 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.809154 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.810156 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.810160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.811448 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:58.811460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:58.812076 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:58.812080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:58.812220 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:58.812772 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:58.812791 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:58.814396 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:58.816245 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.816250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.816263 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.816532 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.816828 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:58.816830 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:58.816832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:58.816980 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:58.817331 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:58.817336 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:58.817568 (+ 232us) client_negotiation.cc:769] Sending connection context
0809 15:40:58.817718 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 15:40:58.817981 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":111,"threads_started":1}
I20260809 15:40:58.819996 24188 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:40:58.820273 24188 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:58.820979 24188 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
I20260809 15:40:58.822089 23520 ts_manager.cc:194] Registered new tserver with Master: 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:40:58.822702 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:48043
I20260809 15:40:58.828001 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.15.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.189.keytab.
Entry for principal oryx/127.14.15.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.189.keytab.
I20260809 15:40:58.858404 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:41923
--webserver_interface=127.14.15.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.189.keytab
--principal=oryx/127.14.15.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39441,127.14.15.189:41923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:40:58.973546 24195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:58.973860 24195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:58.973928 24195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:58.977931 24195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:58.978017 24195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:58.978053 24195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:58.978106 24195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:58.978142 24195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:58.983484 24195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39441,127.14.15.189:41923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.189.keytab
--principal=oryx/127.14.15.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:41923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.15.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
W20260809 15:40:58.983728 24195 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.14.15.190:39441,127.14.15.189:41923'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 15:40:58.984580 24195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:58.985569 24195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:58.994288 24203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.994314 24201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:58.994350 24205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:58.994306 24195 server_base.cc:1034] running on GCE node
I20260809 15:40:58.995071 24195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:58.996186 24195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:58.997367 24195 hybrid_clock.cc:648] HybridClock initialized: now 1786290058997352 us; error 30 us; skew 500 ppm
Aug 09 15:40:58 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.000067 24195 init.cc:377] Logged in from keytab as oryx/127.14.15.189@KRBTEST.COM (short username oryx)
I20260809 15:40:59.000931 24195 webserver.cc:460] Webserver started at http://127.14.15.189:43001/ using document root <none> and password file <none>
I20260809 15:40:59.001484 24195 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.001573 24195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.001801 24195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:59.003907 24195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/instance:
uuid: "dff0ad13c1f54ed882b865c2f314262b"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "6df0dca1cb50ba45c714c3f4833460c9"
server_key_iv: "c2244f2b351f18c4791e204b483a8554"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.004540 24195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal/instance:
uuid: "dff0ad13c1f54ed882b865c2f314262b"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "6df0dca1cb50ba45c714c3f4833460c9"
server_key_iv: "c2244f2b351f18c4791e204b483a8554"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.008279 24195 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 15:40:59.010754 24213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.011924 24195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:40:59.012056 24195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "dff0ad13c1f54ed882b865c2f314262b"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "6df0dca1cb50ba45c714c3f4833460c9"
server_key_iv: "c2244f2b351f18c4791e204b483a8554"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.012202 24195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.031425 24195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.034324 24195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:59.034489 24195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.041495 24195 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.189:41923
I20260809 15:40:59.041787 24284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.189:41923 every 8 connection(s)
I20260809 15:40:59.042608 24195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
I20260809 15:40:59.045466 24285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:59.046236 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 24195
I20260809 15:40:59.050098 24285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.189@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:40:59.062785 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.052011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.14.15.190:39441)
0809 15:40:59.052170 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.052174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.052531 (+ 357us) server_negotiation.cc:407] Connection header received
0809 15:40:59.052718 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.052721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.052773 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.052865 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.053765 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.054573 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.055790 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.056132 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.056233 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.059106 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.059110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.059113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.059139 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.060864 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.061407 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.061410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.061412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.061508 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.061830 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.061835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.061838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.062062 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.062150 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.062580 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.062679 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:40:59.063100 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.047831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52626 (local address 127.14.15.189:41923)
0809 15:40:59.048313 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.048331 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.048632 (+ 301us) server_negotiation.cc:407] Connection header received
0809 15:40:59.049535 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.049558 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.049986 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.050354 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.051234 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.052717 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.053899 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.054481 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.054629 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.057859 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.057866 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.057878 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.057904 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.059776 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.060293 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.060299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.060305 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.060420 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.060709 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.060714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.060715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.061203 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.061406 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.061746 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.062046 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":151,"threads_started":1}
I20260809 15:40:59.063100 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.051995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45728)
0809 15:40:59.052411 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.052459 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.052624 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.053030 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.053035 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.053486 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.053633 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.053640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.054711 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.054715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.055659 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.055672 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.056291 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.056296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.056420 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.056983 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.057000 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.058908 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.060970 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.060976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.060982 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.061254 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.061619 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.061623 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.061624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.061721 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.062172 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.062178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.062320 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.062461 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.062697 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":120,"threads_started":1}
I20260809 15:40:59.064484 24285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290058, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.189@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
I20260809 15:40:59.072602 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.064964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52636)
0809 15:40:59.065146 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.065160 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.065227 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.065491 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.065494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.065652 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.066075 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.066089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.066828 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.066834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.067444 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.067453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.067912 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.067915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.068003 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.068482 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.068496 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.069753 (+ 1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.071316 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.071318 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.071320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.071539 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.071781 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.071783 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.071785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.071861 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.072166 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.072168 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.072243 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.072324 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.072437 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 15:40:59.072628 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.065045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52636 (local address 127.14.15.189:41923)
0809 15:40:59.065323 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.065327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.065338 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:40:59.065370 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.065372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.065402 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.065480 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.066198 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.066727 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.067552 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.067810 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.067916 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.069891 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.069894 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.069896 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.069918 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.071216 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.071628 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.071631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.071632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.071706 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.071931 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.071934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.071935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.072092 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.072165 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.072377 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.072495 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":221}
I20260809 15:40:59.075785 24285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Bootstrap starting.
I20260809 15:40:59.078051 24285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:59.078851 24285 log.cc:824] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:59.080813 24285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: No bootstrap required, opened a new log
I20260809 15:40:59.083935 24285 raft_consensus.cc:348] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } }
I20260809 15:40:59.084167 24285 raft_consensus.cc:374] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:59.084251 24285 raft_consensus.cc:729] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dff0ad13c1f54ed882b865c2f314262b, State: Initialized, Role: FOLLOWER
I20260809 15:40:59.084688 24285 consensus_queue.cc:260] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } }
I20260809 15:40:59.085170 24295 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } } }
I20260809 15:40:59.085287 24295 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:40:59.085860 24285 sys_catalog.cc:564] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:59.087950 24295 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:40:59.088263 24295 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } }
I20260809 15:40:59.089151 24295 leader_election.cc:288] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441)
I20260809 15:40:59.089730 23540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dff0ad13c1f54ed882b865c2f314262b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931362268fa64fb382652b560da8480f" is_pre_election: true
I20260809 15:40:59.090540 24214 leader_election.cc:302] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: dff0ad13c1f54ed882b865c2f314262b; no voters: 931362268fa64fb382652b560da8480f
I20260809 15:40:59.090831 24295 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260809 15:40:59.090922 24310 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:40:59.091048 24310 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:40:59.093815 24195 master_runner.cc:428] Detected that this master dff0ad13c1f54ed882b865c2f314262b is joining an existing cluster
I20260809 15:40:59.093869 24195 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.15.189:41923
I20260809 15:40:59.104596 24317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.096115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45736)
0809 15:40:59.096576 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.096591 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.096707 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.096990 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.096993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.097283 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.097515 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.097521 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.098604 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.098608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.099523 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.099530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.100208 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.100211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.100276 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.100715 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.100729 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.101126 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.103001 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.103009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.103251 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.103526 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103529 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.103531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.103619 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.104027 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.104030 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.104132 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.104241 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.104389 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":91,"thread_start_us":129,"threads_started":1}
I20260809 15:40:59.104594 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.096163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45736 (local address 127.14.15.190:39441)
0809 15:40:59.096301 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.096306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.096684 (+ 378us) server_negotiation.cc:407] Connection header received
0809 15:40:59.096813 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.096816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.096871 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.096965 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.097656 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.098489 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.099640 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.099948 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.100068 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.101253 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.101256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.101259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.101286 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.102880 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103350 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.103354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.103356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.103448 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103709 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.103713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.103715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.103928 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.104037 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.104328 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.104461 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:40:59.104645 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.096181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.14.15.189:41923)
0809 15:40:59.096405 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.096410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.096707 (+ 297us) server_negotiation.cc:407] Connection header received
0809 15:40:59.096855 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.096858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.096900 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.096979 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.097635 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.098137 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.099194 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.099668 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.099779 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.101144 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.101148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.101151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.101176 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.102941 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103436 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.103440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.103441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.103519 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103783 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.103786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.103788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.103975 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.104059 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.104366 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.104477 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":143}
I20260809 15:40:59.105764 24318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.096271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52652)
0809 15:40:59.096637 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.096651 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.096753 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.097086 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.097089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.097291 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.097512 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.097521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.098279 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.098282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.099078 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.099088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.099780 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.099783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.099883 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.100469 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.100486 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.100998 (+ 512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.103055 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.103060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.103359 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.103597 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.103601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.103603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.103706 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.104114 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.104116 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.104199 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.105450 (+ 1251us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.105590 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":35,"spinlock_wait_cycles":896,"thread_start_us":118,"threads_started":1}
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.190@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
I20260809 15:40:59.120077 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.109368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52660 (local address 127.14.15.189:41923)
0809 15:40:59.109483 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.109488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.109797 (+ 309us) server_negotiation.cc:407] Connection header received
0809 15:40:59.109992 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.109995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.110046 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.110132 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.110838 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.111575 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.112668 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.113008 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.113126 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.115691 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.115695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.115698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.115724 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.117860 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.118481 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.118487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.118492 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.118607 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.118972 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.118975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.118977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.119201 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.119303 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.119794 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.119915 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:40:59.120484 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.109318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52660)
0809 15:40:59.109671 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.109720 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.109850 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.110200 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.110205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.110605 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.110724 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.110731 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.111746 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.111749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.112500 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.112510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.113169 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.113175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.113269 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.113835 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.113847 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.115548 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.117986 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.117997 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.118003 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.118371 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.118744 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.118748 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.118750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.118854 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.119334 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.119345 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.119535 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.119706 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.119938 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":109,"threads_started":1}
I20260809 15:40:59.122206 23520 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.15.189:41923: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b"
member_type: NON_VOTER
last_known_addr {
host: "127.14.15.189"
port: 41923
}
attrs {
promote: true
}
}
dest_uuid: "931362268fa64fb382652b560da8480f"
cas_config_opid_index: -1
I20260809 15:40:59.123174 23520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } }
I20260809 15:40:59.125814 24248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:59.125844 24325 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dff0ad13c1f54ed882b865c2f314262b (127.14.15.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } }
I20260809 15:40:59.127303 24248 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
WARNING: no policy specified for oryx/127.14.15.188@KRBTEST.COM; defaulting to no policy
I20260809 15:40:59.128019 24322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:40:59.128281 24325 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.15.189:41923
I20260809 15:40:59.128764 24195 master.cc:537] Master@127.14.15.189:41923 shutting down...
I20260809 15:40:59.129767 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } }
I20260809 15:40:59.129896 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
W20260809 15:40:59.130262 23501 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.188@KRBTEST.COM" created.
W20260809 15:40:59.131347 23501 consensus_peers.cc:487] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f -> Peer dff0ad13c1f54ed882b865c2f314262b (127.14.15.189:41923): Couldn't send request to peer dff0ad13c1f54ed882b865c2f314262b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 15:40:59.134078 24195 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:59.134428 24195 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:59.134562 24195 tablet_replica.cc:330] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.188.keytab.
Entry for principal oryx/127.14.15.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.188.keytab.
I20260809 15:40:59.149150 24195 master.cc:552] Master@127.14.15.189:41923 shutdown complete.
I20260809 15:40:59.149220 24195 master_runner.cc:305] Clearing existing system tablet
I20260809 15:40:59.149453 24195 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.149521 24195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.149652 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:42755
--webserver_interface=127.14.15.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.188.keytab
--principal=oryx/127.14.15.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:40:59.151684 24195 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:59.152686 24335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.152980 24195 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.153244 24195 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:59.153328 24195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "dff0ad13c1f54ed882b865c2f314262b"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "6df0dca1cb50ba45c714c3f4833460c9"
server_key_iv: "c2244f2b351f18c4791e204b483a8554"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.155673 24195 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:59.158147 24195 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 15:40:59.158331 24195 log.cc:1196] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 15:40:59.158684 24195 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Deleting consensus metadata
I20260809 15:40:59.158908 24195 master_runner.cc:315] Copying system tablet from 127.14.15.190:39441
I20260809 15:40:59.160321 24195 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: tablet copy: Beginning tablet copy session from remote peer at address 127.14.15.190:39441
I20260809 15:40:59.169747 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.161139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45750 (local address 127.14.15.190:39441)
0809 15:40:59.161289 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.161292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.161395 (+ 103us) server_negotiation.cc:407] Connection header received
0809 15:40:59.161618 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.161622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.161673 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.161724 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.162442 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.163254 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.164476 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.164827 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.164935 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.166264 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.166268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.166271 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.166300 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.167962 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.168464 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.168467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.168469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.168571 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.168850 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.168853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.168855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.169078 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.169179 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.169469 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.169589 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:40:59.169749 24345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.161045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45750)
0809 15:40:59.161299 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.161315 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.161501 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.161876 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.161879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.162106 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.162285 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.162294 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.163367 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.163371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.164348 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.164360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.164951 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.164955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.165056 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.165653 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.165668 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.166087 (+ 419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.168094 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.168098 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.168100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.168358 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.168670 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.168673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.168675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.168770 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.169176 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.169179 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.169282 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.169385 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.169525 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
I20260809 15:40:59.170773 23552 tablet_copy_service.cc:140] P 931362268fa64fb382652b560da8480f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dff0ad13c1f54ed882b865c2f314262b ({username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:45750)
I20260809 15:40:59.170953 23552 tablet_copy_service.cc:161] P 931362268fa64fb382652b560da8480f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dff0ad13c1f54ed882b865c2f314262b at {username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:45750: session id = dff0ad13c1f54ed882b865c2f314262b-00000000000000000000000000000000
I20260809 15:40:59.172906 23552 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 15:40:59.174887 24195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 15:40:59.177388 24195 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: tablet copy: Starting download of 0 data blocks...
I20260809 15:40:59.177595 24195 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: tablet copy: Starting download of 1 WAL segments...
I20260809 15:40:59.179361 24195 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 15:40:59.181169 23552 tablet_copy_service.cc:342] P 931362268fa64fb382652b560da8480f: Request end of tablet copy session dff0ad13c1f54ed882b865c2f314262b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:45750
I20260809 15:40:59.181264 23552 tablet_copy_service.cc:433] P 931362268fa64fb382652b560da8480f: ending tablet copy session dff0ad13c1f54ed882b865c2f314262b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dff0ad13c1f54ed882b865c2f314262b
I20260809 15:40:59.188730 24195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:59.190425 24346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.194945 24347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.195204 24350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:59.198410 24195 server_base.cc:1034] running on GCE node
I20260809 15:40:59.198601 24195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:59.198920 24195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:59.200083 24195 hybrid_clock.cc:648] HybridClock initialized: now 1786290059200056 us; error 41 us; skew 500 ppm
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.201834 24195 init.cc:377] Logged in from keytab as oryx/127.14.15.189@KRBTEST.COM (short username oryx)
I20260809 15:40:59.202386 24195 webserver.cc:460] Webserver started at http://127.14.15.189:40945/ using document root <none> and password file <none>
I20260809 15:40:59.202602 24195 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.202652 24195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.204115 24195 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:59.205201 24359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.205462 24195 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:40:59.205551 24195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "dff0ad13c1f54ed882b865c2f314262b"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "6df0dca1cb50ba45c714c3f4833460c9"
server_key_iv: "c2244f2b351f18c4791e204b483a8554"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.205638 24195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.230902 24195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.233225 24195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.239496 24195 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.189:41923
I20260809 15:40:59.239542 24438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.189:41923 every 8 connection(s)
I20260809 15:40:59.240288 24195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
I20260809 15:40:59.242645 24439 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:40:59.243975 24439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Bootstrap starting.
I20260809 15:40:59.255821 24439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:40:59.256162 24439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Bootstrap complete.
I20260809 15:40:59.256826 24439 raft_consensus.cc:348] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } }
I20260809 15:40:59.256969 24439 raft_consensus.cc:729] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dff0ad13c1f54ed882b865c2f314262b, State: Initialized, Role: LEARNER
I20260809 15:40:59.257084 24439 consensus_queue.cc:260] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } }
I20260809 15:40:59.257478 24444 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } }
I20260809 15:40:59.257606 24439 sys_catalog.cc:564] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:59.257687 24444 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: LEARNER
I20260809 15:40:59.261044 24467 catalog_manager.cc:1259] Loaded cluster ID: 0c33b6f09d504a0997934c9cff1146a4
I20260809 15:40:59.261116 24467 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: loading cluster ID for follower catalog manager: success
I20260809 15:40:59.263306 24467 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: acquiring CA information for follower catalog manager: success
I20260809 15:40:59.264714 24467 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 15:40:59.283965 24334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:59.284267 24334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:59.284344 24334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:59.288404 24334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:40:59.288486 24334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:59.288528 24334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:59.288580 24334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:40:59.288620 24334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:40:59.293983 24334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.188.keytab
--principal=oryx/127.14.15.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:42755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.15.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:59.295138 24334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:59.296182 24334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:59.304908 24478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.304948 24481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.304908 24476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:59.305413 24334 server_base.cc:1034] running on GCE node
I20260809 15:40:59.306026 24334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:59.307303 24334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:59.308502 24334 hybrid_clock.cc:648] HybridClock initialized: now 1786290059308478 us; error 43 us; skew 500 ppm
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.311288 24334 init.cc:377] Logged in from keytab as oryx/127.14.15.188@KRBTEST.COM (short username oryx)
I20260809 15:40:59.312183 24334 webserver.cc:460] Webserver started at http://127.14.15.188:42781/ using document root <none> and password file <none>
I20260809 15:40:59.312719 24334 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.312777 24334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.312953 24334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:40:59.315127 24334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/instance:
uuid: "d0169e5eaba846a1a500c9062f5176fa"
format_stamp: "Formatted at 2026-08-09 15:40:59 on dist-test-slave-jztv"
server_key: "b7344230043c1319dd22d4b65d2b3d02"
server_key_iv: "871a2386e01a9f3a6201b527a3d3164c"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.315716 24334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal/instance:
uuid: "d0169e5eaba846a1a500c9062f5176fa"
format_stamp: "Formatted at 2026-08-09 15:40:59 on dist-test-slave-jztv"
server_key: "b7344230043c1319dd22d4b65d2b3d02"
server_key_iv: "871a2386e01a9f3a6201b527a3d3164c"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.319674 24334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:40:59.322157 24492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.323428 24334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:59.323575 24334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "d0169e5eaba846a1a500c9062f5176fa"
format_stamp: "Formatted at 2026-08-09 15:40:59 on dist-test-slave-jztv"
server_key: "b7344230043c1319dd22d4b65d2b3d02"
server_key_iv: "871a2386e01a9f3a6201b527a3d3164c"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.323684 24334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.345535 24334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.348843 24334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:59.349077 24334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.356760 24334 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.188:42755
I20260809 15:40:59.357069 24570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.188:42755 every 8 connection(s)
I20260809 15:40:59.357848 24334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
I20260809 15:40:59.360913 24573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:40:59.364816 24573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:40:59.367707 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 24334
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.188@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
I20260809 15:40:59.380030 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.366871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45752 (local address 127.14.15.190:39441)
0809 15:40:59.367006 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.367009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.367945 (+ 936us) server_negotiation.cc:407] Connection header received
0809 15:40:59.369209 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.369212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.369279 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.369369 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.370494 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.371081 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.372341 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.372664 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.372769 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.375969 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.375972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.375974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.376000 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.377583 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.378273 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.378277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.378279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.378375 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.378727 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.378731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.378732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.378982 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.379073 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.379706 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.379845 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:40:59.381017 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.368706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.14.15.188:42755)
0809 15:40:59.369061 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.369071 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.369104 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:40:59.369222 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.369226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.369393 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.369547 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.370483 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.371778 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.372734 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.373089 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.373203 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.376323 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.376330 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.376342 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.376374 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.378130 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.378850 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.378855 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.378856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.378934 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.379213 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.379216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.379218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.379505 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.379718 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.379947 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.380072 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":167,"threads_started":1}
I20260809 15:40:59.381018 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.367142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45752)
0809 15:40:59.367768 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.367836 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.369001 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.369426 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.369435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.369952 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.370358 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.370382 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.371227 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.371230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.372210 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.372221 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.372940 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.372945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.373148 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.373785 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.373805 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.375828 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.377705 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.377713 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.377723 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.378130 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.378472 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.378474 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.378475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.378622 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.379133 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.379138 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.379469 (+ 331us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.379644 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.379997 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":51,"thread_start_us":131,"threads_started":1}
I20260809 15:40:59.382381 24573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.188@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
I20260809 15:40:59.391121 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.382883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52674)
0809 15:40:59.383038 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.383052 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.383139 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.383581 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.383584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.383757 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.383852 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.383857 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.384772 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.384777 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.385326 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.385334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.385818 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.385822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.385930 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.386465 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.386484 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.387727 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.389562 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.389567 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.389569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.389773 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.390060 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.390063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.390065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.390161 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.390573 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.390576 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.390704 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.390827 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.390973 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 15:40:59.391176 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.383002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52674 (local address 127.14.15.189:41923)
0809 15:40:59.383355 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.383361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.383377 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:40:59.383425 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.383427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.383468 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.383566 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.383970 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.384660 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.385454 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.385699 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.385803 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.387875 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.387879 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.387881 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.387914 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.389443 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.389874 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.389878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.389880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.389966 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.390276 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.390279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.390281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.390474 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.390585 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.390931 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.391051 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":172,"threads_started":1}
I20260809 15:40:59.391994 24573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:40:59.395467 23804 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.188@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
I20260809 15:40:59.400049 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.392533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51434 (local address 127.14.15.188:42755)
0809 15:40:59.392655 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.392661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.392674 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:40:59.392799 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.392802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.392845 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.392918 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.393267 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.393772 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.394532 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.394770 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.394873 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.396958 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.396967 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.396969 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.396989 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.398433 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.398884 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.398890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.398891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.398965 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.399225 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.399229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.399231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.399408 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.399512 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.399743 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.399889 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":57}
I20260809 15:40:59.400049 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.392496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51434)
0809 15:40:59.392611 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.392624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.392706 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.392928 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.392931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.393099 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.393163 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.393167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.393881 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.393887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.394420 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.394428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.394869 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.394873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.394983 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.395380 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.395393 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.396844 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.398550 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.398555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.398557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.398789 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.399052 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.399056 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.399058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.399139 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.399500 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.399502 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.399585 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.399698 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.399837 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":20}
I20260809 15:40:59.403570 24573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Bootstrap starting.
I20260809 15:40:59.406001 24573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Neither blocks nor log segments found. Creating new log.
I20260809 15:40:59.406824 24573 log.cc:824] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Log is configured to *not* fsync() on all Append() calls
I20260809 15:40:59.408841 24573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: No bootstrap required, opened a new log
I20260809 15:40:59.412029 24573 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } }
I20260809 15:40:59.412285 24573 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:40:59.412374 24573 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0169e5eaba846a1a500c9062f5176fa, State: Initialized, Role: FOLLOWER
I20260809 15:40:59.412823 24573 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } }
I20260809 15:40:59.413424 24580 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } } }
I20260809 15:40:59.413590 24580 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:40:59.414382 24573 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:40:59.419210 24598 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:40:59.419317 24598 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:40:59.422725 24334 master_runner.cc:428] Detected that this master d0169e5eaba846a1a500c9062f5176fa is joining an existing cluster
I20260809 15:40:59.422783 24334 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.15.188:42755
I20260809 15:40:59.434120 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.426036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.14.15.190:39441)
0809 15:40:59.426175 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.426180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.426194 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:40:59.426268 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.426271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.426328 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.426421 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.427073 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.427924 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.429187 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.429497 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.429574 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.430910 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.430913 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.430915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.430940 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.432344 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.432838 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.432840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.432841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.432917 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.433200 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.433202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.433203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.433368 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.433440 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.433810 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.433941 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:40:59.434592 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.425113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45764)
0809 15:40:59.425929 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.425945 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.426043 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.426450 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.426455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.426766 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.426934 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.426945 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.428113 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.428117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.429031 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.429043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.429730 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.429733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.429827 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.430286 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.430301 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.430776 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.432467 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.432471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.432473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.432741 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.433004 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.433007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.433009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.433108 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.433492 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.433495 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.433612 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.433723 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.433865 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":5,"thread_start_us":187,"threads_started":1}
I20260809 15:40:59.434736 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 23614
I20260809 15:40:59.445812 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.425658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51446)
0809 15:40:59.436658 (+ 11000us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.436673 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.436801 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.437158 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.437160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.437343 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.437454 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.437461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.438740 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.438744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.439627 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.439638 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.440383 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.440387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.440518 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.441108 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.441123 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.441551 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.444006 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.444009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.444012 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.444263 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.444625 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.444629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.444630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.444723 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.445269 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.445272 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.445368 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.445487 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.445622 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10881,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
I20260809 15:40:59.446420 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.425690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51446 (local address 127.14.15.188:42755)
0809 15:40:59.425815 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.425820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.436726 (+ 10906us) server_negotiation.cc:407] Connection header received
0809 15:40:59.436931 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.436934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.436996 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.437042 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.437581 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.438619 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.439758 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.440251 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.440461 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.441720 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.441728 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.441734 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.441771 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.443876 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.444376 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.444383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.444388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.444506 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.444822 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.444829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.444833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.445150 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.445279 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.445579 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.445739 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":47}
I20260809 15:40:59.456992 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.425341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52676 (local address 127.14.15.189:41923)
0809 15:40:59.425474 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.425480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.426239 (+ 759us) server_negotiation.cc:407] Connection header received
0809 15:40:59.426335 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.426338 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.426407 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.426478 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.427113 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.427678 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.428713 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.428954 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.429062 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.452867 (+ 23805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.452874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.452881 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.452922 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.454808 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.455357 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.455364 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.455368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.455474 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.455852 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.455857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.455862 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.456118 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.456197 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.456591 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.456745 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:40:59.457679 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.425228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52676)
0809 15:40:59.426129 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.426142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.426245 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.426616 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.426619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.426856 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.426968 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.426976 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.427794 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.427798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.428591 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.428600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.429076 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.429079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.429169 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.429693 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.429712 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.452658 (+ 22946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.454942 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.454948 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.454953 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.455227 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.455618 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.455623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.455628 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.455739 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.456275 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.456281 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.456393 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.457221 (+ 828us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.457383 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":1,"thread_start_us":92,"threads_started":1}
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290057, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.190@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
I20260809 15:40:59.459769 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:40209
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:39441
--webserver_port=42857
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:40:59.463515 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.454101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51452 (local address 127.14.15.188:42755)
0809 15:40:59.454263 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.454267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.454280 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:40:59.454349 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.454352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.454403 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.454995 (+ 592us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.455099 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.455867 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.457026 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.457358 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.458288 (+ 930us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.459821 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.459827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.459986 (+ 159us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.460018 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.461763 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.462199 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.462202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.462204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.462317 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.462717 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.462725 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.462726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.462890 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.462997 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.463268 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.463372 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:40:59.463517 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.453090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51452)
0809 15:40:59.453624 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.453640 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.453723 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.454550 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.454553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.454762 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.454883 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.454890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.456000 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.456004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.456874 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.456886 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.457493 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.457497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.457594 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.458057 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.458071 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.459674 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.461884 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.461888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.461890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.462096 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.462413 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.462416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.462418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.462590 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.462993 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.462996 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.463102 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.463205 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.463362 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432}
I20260809 15:40:59.465070 23520 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.15.188:42755: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa"
member_type: NON_VOTER
last_known_addr {
host: "127.14.15.188"
port: 42755
}
attrs {
promote: true
}
}
dest_uuid: "931362268fa64fb382652b560da8480f"
cas_config_opid_index: 5
I20260809 15:40:59.465744 23520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } }
I20260809 15:40:59.467135 24325 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d0169e5eaba846a1a500c9062f5176fa (127.14.15.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.468662 24325 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.15.188:42755
I20260809 15:40:59.468843 24325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.468950 24325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:59.469502 24334 master.cc:537] Master@127.14.15.188:42755 shutting down...
I20260809 15:40:59.469888 24526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:40:59.471494 24526 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 15:40:59.472273 24322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:40:59.474651 23496 consensus_peers.cc:487] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f -> Peer d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755): Couldn't send request to peer d0169e5eaba846a1a500c9062f5176fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 15:40:59.477504 24334 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:40:59.477823 24334 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:40:59.477921 24334 tablet_replica.cc:330] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: stopping tablet replica
I20260809 15:40:59.479667 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.467001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52688)
0809 15:40:59.471681 (+ 4680us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.471700 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.471807 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.474505 (+ 2698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.474509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.474529 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:40:59.474632 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.474638 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.476426 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.476430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.477857 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.477871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.479168 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.479172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.479273 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.479324 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.479419 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.479515 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4549}
I20260809 15:40:59.480113 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.467116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.14.15.189:41923)
0809 15:40:59.467261 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.467268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.474078 (+ 6810us) server_negotiation.cc:407] Connection header received
0809 15:40:59.474147 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.474150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.474251 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.474346 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:40:59.474847 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.475682 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.478113 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.478823 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.478929 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.479097 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.479910 (+ 813us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.479995 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:40:59.480926 24402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 LEARNER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 15:40:59.481376 24322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 15:40:59.483502 24402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d0169e5eaba846a1a500c9062f5176fa (127.14.15.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.485761 24444 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931362268fa64fb382652b560da8480f. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.485872 24444 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: LEARNER
I20260809 15:40:59.485942 24444 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: NON_VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: true } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.486002 24444 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: LEARNER
I20260809 15:40:59.486572 24322 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: attempting to promote NON_VOTER dff0ad13c1f54ed882b865c2f314262b to VOTER
I20260809 15:40:59.487061 24322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } }
I20260809 15:40:59.488353 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.488036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51468)
0809 15:40:59.488179 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.488262 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 15:40:59.488868 24402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 LEARNER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 15:40:59.489327 24329 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 15:40:59.489434 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.488844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51476)
0809 15:40:59.489288 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.489343 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365}
W20260809 15:40:59.489650 23496 consensus_peers.cc:487] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f -> Peer d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755): Couldn't send request to peer d0169e5eaba846a1a500c9062f5176fa. Status: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 15:40:59.491047 24326 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dff0ad13c1f54ed882b865c2f314262b (127.14.15.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.491511 24402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dff0ad13c1f54ed882b865c2f314262b (127.14.15.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.492617 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.492720 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:59.492847 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.492909 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:40:59.493297 24611 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.493566 24611 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:40:59.497123 24334 master.cc:552] Master@127.14.15.188:42755 shutdown complete.
I20260809 15:40:59.497188 24334 master_runner.cc:305] Clearing existing system tablet
I20260809 15:40:59.497457 24334 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.497520 24334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.498975 24334 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 15:40:59.499969 24613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.500180 24334 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.500451 24334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:59.500535 24334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "d0169e5eaba846a1a500c9062f5176fa"
format_stamp: "Formatted at 2026-08-09 15:40:59 on dist-test-slave-jztv"
server_key: "b7344230043c1319dd22d4b65d2b3d02"
server_key_iv: "871a2386e01a9f3a6201b527a3d3164c"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.502712 24334 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:40:59.505461 24334 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 15:40:59.505640 24334 log.cc:1196] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 15:40:59.505976 24334 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Deleting consensus metadata
I20260809 15:40:59.506203 24334 master_runner.cc:315] Copying system tablet from 127.14.15.190:39441
I20260809 15:40:59.507534 24334 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: tablet copy: Beginning tablet copy session from remote peer at address 127.14.15.190:39441
I20260809 15:40:59.517309 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.508475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45772 (local address 127.14.15.190:39441)
0809 15:40:59.508603 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.508608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.508625 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:40:59.508689 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.508693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.508743 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.508829 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.509440 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.510200 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.511443 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.511793 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.511913 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.513361 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.513366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.513369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.513398 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.515240 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.515803 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.515806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.515808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.515906 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.516275 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.516281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.516285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.516623 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.516726 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.517011 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.517131 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:40:59.517509 24623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.508176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:45772)
0809 15:40:59.508443 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.508459 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.508590 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.508866 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.508869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.509102 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.509248 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.509256 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.510368 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.510373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.511286 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.511298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.512053 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.512058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.512161 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.512762 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.512777 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.513217 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.515345 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.515348 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.515351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.515706 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.516025 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.516028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.516031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.516129 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.516726 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.516729 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.516835 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.516945 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.517093 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
I20260809 15:40:59.518155 23552 tablet_copy_service.cc:140] P 931362268fa64fb382652b560da8480f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d0169e5eaba846a1a500c9062f5176fa ({username='oryx', principal='oryx/127.14.15.188@KRBTEST.COM'} at 127.0.0.1:45772)
I20260809 15:40:59.518287 23552 tablet_copy_service.cc:161] P 931362268fa64fb382652b560da8480f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d0169e5eaba846a1a500c9062f5176fa at {username='oryx', principal='oryx/127.14.15.188@KRBTEST.COM'} at 127.0.0.1:45772: session id = d0169e5eaba846a1a500c9062f5176fa-00000000000000000000000000000000
I20260809 15:40:59.519382 23552 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 15:40:59.520781 24334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 15:40:59.523712 24334 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: tablet copy: Starting download of 0 data blocks...
I20260809 15:40:59.523911 24334 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: tablet copy: Starting download of 1 WAL segments...
I20260809 15:40:59.525465 24334 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 15:40:59.527413 23552 tablet_copy_service.cc:342] P 931362268fa64fb382652b560da8480f: Request end of tablet copy session d0169e5eaba846a1a500c9062f5176fa-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.15.188@KRBTEST.COM'} at 127.0.0.1:45772
I20260809 15:40:59.527501 23552 tablet_copy_service.cc:433] P 931362268fa64fb382652b560da8480f: ending tablet copy session d0169e5eaba846a1a500c9062f5176fa-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d0169e5eaba846a1a500c9062f5176fa
I20260809 15:40:59.535315 24334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:59.537289 24624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.539328 24630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.539479 24627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:59.539812 24334 server_base.cc:1034] running on GCE node
I20260809 15:40:59.539983 24334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:59.540277 24334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:59.541424 24334 hybrid_clock.cc:648] HybridClock initialized: now 1786290059541396 us; error 43 us; skew 500 ppm
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.543126 24334 init.cc:377] Logged in from keytab as oryx/127.14.15.188@KRBTEST.COM (short username oryx)
I20260809 15:40:59.543617 24334 webserver.cc:460] Webserver started at http://127.14.15.188:33225/ using document root <none> and password file <none>
I20260809 15:40:59.543812 24334 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.543855 24334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.545528 24334 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:59.546797 24640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.547077 24334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 15:40:59.547160 24334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "d0169e5eaba846a1a500c9062f5176fa"
format_stamp: "Formatted at 2026-08-09 15:40:59 on dist-test-slave-jztv"
server_key: "b7344230043c1319dd22d4b65d2b3d02"
server_key_iv: "871a2386e01a9f3a6201b527a3d3164c"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.547256 24334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.597050 24334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.599483 24334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.604657 24334 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.188:42755
I20260809 15:40:59.605121 24723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.188:42755 every 8 connection(s)
I20260809 15:40:59.605520 24334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
I20260809 15:40:59.607456 24724 sys_catalog.cc:263] Verifying existing consensus state
W20260809 15:40:59.607764 24609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:59.608119 24609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:59.608203 24609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:40:59.608562 24724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Bootstrap starting.
I20260809 15:40:59.611939 24000 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
W20260809 15:40:59.613935 24609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:59.613992 24609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:59.614055 24609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:40:59.618841 24724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:40:59.619144 24724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: Bootstrap complete.
I20260809 15:40:59.619697 24609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:40209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=42857
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:59.619699 24724 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } }
I20260809 15:40:59.619846 24724 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d0169e5eaba846a1a500c9062f5176fa, State: Initialized, Role: LEARNER
I20260809 15:40:59.619983 24724 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } }
I20260809 15:40:59.620352 24729 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:40:59.620471 24729 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: LEARNER
I20260809 15:40:59.620501 24724 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:40:59.620910 24609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:59.621994 24609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:40:59.623360 24744 catalog_manager.cc:1259] Loaded cluster ID: 0c33b6f09d504a0997934c9cff1146a4
I20260809 15:40:59.623477 24744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: loading cluster ID for follower catalog manager: success
I20260809 15:40:59.625571 24744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: acquiring CA information for follower catalog manager: success
I20260809 15:40:59.626961 24744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 15:40:59.632948 24746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.632948 24747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.632977 24749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:59.633162 24609 server_base.cc:1034] running on GCE node
I20260809 15:40:59.633651 24609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:59.634399 24609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:59.635593 24609 hybrid_clock.cc:648] HybridClock initialized: now 1786290059635573 us; error 31 us; skew 500 ppm
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.638522 24609 init.cc:377] Logged in from keytab as oryx/127.14.15.129@KRBTEST.COM (short username oryx)
I20260809 15:40:59.639469 24609 webserver.cc:460] Webserver started at http://127.14.15.129:42857/ using document root <none> and password file <none>
I20260809 15:40:59.640055 24609 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.640165 24609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.644266 24609 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:40:59.646572 24758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.647833 24609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:40:59.647961 24609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "bad54bf5e19a444fb3fa48cebf2b4851"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "d92170ca90ab714908ca76b257fe21d6"
server_key_iv: "ded510d3c8147aa5d76a577d17c91604"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.648577 24609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.670166 24609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.673332 24609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:59.673533 24609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.674271 24609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:59.675242 24609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:59.675293 24609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.675356 24609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:59.675386 24609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.686605 24609 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:40209
I20260809 15:40:59.686627 24918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:40209 every 8 connection(s)
I20260809 15:40:59.687686 24609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:40:59.689189 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 24609
I20260809 15:40:59.689391 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 23813
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:40:59.716589 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.694138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:55861 (local address 127.14.15.189:41923)
0809 15:40:59.694312 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.694318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.699332 (+ 5014us) server_negotiation.cc:407] Connection header received
0809 15:40:59.701199 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.701204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.701266 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.701318 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.703306 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.704031 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.705920 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.706281 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.706375 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.711513 (+ 5138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.711517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.711521 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.711557 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.713824 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.714576 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.714580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.714582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.714689 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.715155 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.715161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.715162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.715416 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.715510 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.716285 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.716414 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
I20260809 15:40:59.720767 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.690144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.14.15.129:55861)
0809 15:40:59.699139 (+ 8995us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.699217 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.700516 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.701665 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.701675 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.702248 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.703122 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.703143 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.704205 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.704211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.705778 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.705792 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.706635 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.706641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.706876 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.707588 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.707613 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.710043 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.713995 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.714002 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.714022 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.714450 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.714815 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.714818 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.714820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.715005 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.715594 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.715601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.715960 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.716826 (+ 866us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.719452 (+ 2626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8714,"thread_start_us":1381,"threads_started":1}
I20260809 15:40:59.721557 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.698333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41841 (local address 127.14.15.190:39441)
0809 15:40:59.698472 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.698478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.709409 (+ 10931us) server_negotiation.cc:407] Connection header received
0809 15:40:59.709616 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.709620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.709677 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.709734 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.710375 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.711154 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.712395 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.712775 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.712865 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.716831 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.716835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.716838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.716871 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.718975 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.719726 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.719730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.719731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.719829 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.720128 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.720131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.720133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.720359 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.720445 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.721239 (+ 794us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.721387 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:40:59.722586 24921 heartbeater.cc:347] Connected to a master server at 127.14.15.189:41923
I20260809 15:40:59.722945 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.697738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:41841)
0809 15:40:59.709309 (+ 11571us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.709324 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.709480 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.709878 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.709881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.710057 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.710205 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.710244 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.711289 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.711292 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.712235 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.712252 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.713056 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.713061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.713164 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.714601 (+ 1437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.714614 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.716112 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.719162 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.719165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.719167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.719616 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.719939 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.719942 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.719944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.720024 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.720503 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.720505 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.720609 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.721778 (+ 1169us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.721935 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11496,"thread_start_us":275,"threads_started":1}
I20260809 15:40:59.723142 24921 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.723572 24920 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:40:59.723662 24920 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.723762 24921 heartbeater.cc:511] Master 127.14.15.189:41923 requested a full tablet report, sending...
I20260809 15:40:59.723802 24920 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
I20260809 15:40:59.725059 23520 ts_manager.cc:194] Re-registered known tserver with Master: bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209)
I20260809 15:40:59.725337 24388 ts_manager.cc:194] Registered new tserver with Master: bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209)
I20260809 15:40:59.725821 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:41841
I20260809 15:40:59.730087 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.695933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.14.15.129:57917)
0809 15:40:59.700869 (+ 4936us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.700885 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.700965 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.709074 (+ 8109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.709087 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.709302 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.709462 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.709469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.713474 (+ 4005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.713478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.714431 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.714443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.717253 (+ 2810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.717260 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.717377 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.717797 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.717810 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.719354 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.728162 (+ 8808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.728165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.728168 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.728454 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.728763 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.728769 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.728773 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.728864 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.729372 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.729378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.729494 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.729589 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.729789 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4853,"thread_start_us":1363,"threads_started":1}
I20260809 15:40:59.730789 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.697468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:57917 (local address 127.14.15.188:42755)
0809 15:40:59.708808 (+ 11340us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.708813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.708831 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:40:59.708881 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.708884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.708942 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.709056 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.710267 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.711344 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.716282 (+ 4938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.716655 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.717624 (+ 969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.720800 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.720804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.720807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.720836 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.728003 (+ 7167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.728567 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.728573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.728578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.728671 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.728973 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.728979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.728983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.729249 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.730428 (+ 1179us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.730506 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.730638 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11236,"thread_start_us":533,"threads_started":1}
I20260809 15:40:59.731496 24919 heartbeater.cc:347] Connected to a master server at 127.14.15.188:42755
I20260809 15:40:59.731618 24919 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.731861 24919 heartbeater.cc:511] Master 127.14.15.188:42755 requested a full tablet report, sending...
I20260809 15:40:59.732968 24671 ts_manager.cc:194] Registered new tserver with Master: bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209)
I20260809 15:40:59.736511 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:42491
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:39441
--webserver_port=33727
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:40:59.824676 24188 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
W20260809 15:40:59.856506 24928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:40:59.856787 24928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:40:59.856863 24928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:40:59.861104 24928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:40:59.861171 24928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:40:59.861264 24928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:40:59.866658 24928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:42491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=33727
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:40:59.867816 24928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:40:59.868906 24928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:40:59.878724 24934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.878769 24938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:40:59.878747 24935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:40:59.878886 24928 server_base.cc:1034] running on GCE node
I20260809 15:40:59.879346 24928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:40:59.880014 24928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:40:59.881204 24928 hybrid_clock.cc:648] HybridClock initialized: now 1786290059881186 us; error 29 us; skew 500 ppm
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:40:59.884159 24928 init.cc:377] Logged in from keytab as oryx/127.14.15.130@KRBTEST.COM (short username oryx)
I20260809 15:40:59.885077 24928 webserver.cc:460] Webserver started at http://127.14.15.130:33727/ using document root <none> and password file <none>
I20260809 15:40:59.885660 24928 fs_manager.cc:359] Metadata directory not provided
I20260809 15:40:59.885777 24928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:40:59.889599 24928 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:40:59.891712 24955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.892918 24928 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:40:59.893055 24928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "286f0962394b4fa89f88f74f812948f8"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "c3afe534edda8ede99fa9fdd0d8a892b"
server_key_iv: "3badb87485493bd2c3b5d160c0610754"
server_key_version: "encryptionkey@0"
I20260809 15:40:59.893652 24928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:40:59.908774 24928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:40:59.911721 24928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:40:59.911916 24928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:40:59.912500 24928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:40:59.913403 24928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:40:59.913483 24928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.913553 24928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:40:59.913599 24928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:40:59.923573 24928 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:42491
I20260809 15:40:59.923640 25113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:42491 every 8 connection(s)
I20260809 15:40:59.924628 24928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:40:59.933914 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 24928
I20260809 15:40:59.934123 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 24006
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
Aug 09 15:40:59 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290059, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
I20260809 15:40:59.942240 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.926570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56683 (local address 127.14.15.190:39441)
0809 15:40:59.926712 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.926717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.927659 (+ 942us) server_negotiation.cc:407] Connection header received
0809 15:40:59.928791 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.928794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.928859 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.928957 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.930601 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931432 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.932748 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.933055 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.933181 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.937253 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.937256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.937258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.937288 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.939526 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940277 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.940388 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940784 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.941014 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.941087 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.941914 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.942045 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:40:59.942240 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.928164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:40369 (local address 127.14.15.188:42755)
0809 15:40:59.928301 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.928305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.928377 (+ 72us) server_negotiation.cc:407] Connection header received
0809 15:40:59.928804 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.928807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.928865 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.928916 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.930649 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931492 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.932518 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.932831 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.932934 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.937208 (+ 4274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.937213 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.937215 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.937247 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.939526 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940277 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.940388 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940784 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.941014 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.941087 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.941918 (+ 831us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.942045 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:40:59.942339 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.926676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:49417 (local address 127.14.15.189:41923)
0809 15:40:59.926837 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:40:59.926842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:40:59.927666 (+ 824us) server_negotiation.cc:407] Connection header received
0809 15:40:59.928804 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:40:59.928808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:40:59.928862 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:40:59.928916 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:40:59.930638 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931179 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.932770 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.933067 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.933148 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.937357 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:40:59.937364 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:40:59.937370 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:40:59.937406 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:40:59.939386 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940214 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.940323 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940791 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:40:59.940797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:40:59.940802 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:40:59.941063 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:40:59.941139 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 15:40:59.941912 (+ 773us) server_negotiation.cc:299] Negotiation successful
0809 15:40:59.942060 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:40:59.944041 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.928049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.14.15.130:40369)
0809 15:40:59.928304 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.928319 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.928593 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.929132 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.929140 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.929746 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.930470 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.930480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931630 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.931633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.932392 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.932401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.932979 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.932983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.933174 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.933891 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.933913 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.937012 (+ 3099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.939657 (+ 2645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.939660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.939662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940154 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.940509 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.940514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940666 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.941176 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.941183 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.941617 (+ 434us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.942631 (+ 1014us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.942880 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":253,"spinlock_wait_cycles":29568,"thread_start_us":104,"threads_started":1}
I20260809 15:40:59.944046 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.926988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.14.15.130:49417)
0809 15:40:59.927502 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.927553 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.928593 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.929132 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.929140 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.929750 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.930469 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.930480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931342 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.931345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.932629 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.932640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.933311 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.933314 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.933439 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.934156 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.934202 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.937211 (+ 3009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.939535 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.939544 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.939563 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940079 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.940462 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.940472 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940674 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.941218 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.941224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.941606 (+ 382us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.942873 (+ 1267us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.943036 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":185,"spinlock_wait_cycles":125824,"thread_start_us":168,"threads_started":1}
I20260809 15:40:59.944298 25123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:40:59.927019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:56683)
0809 15:40:59.927517 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 15:40:59.927557 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:40:59.928582 (+ 1025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:40:59.929131 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:40:59.929138 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:40:59.929739 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:40:59.930458 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.930475 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.931551 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.931554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.932629 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:40:59.932640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:40:59.933183 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:40:59.933187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:40:59.933280 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:40:59.933948 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:40:59.933969 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:40:59.937071 (+ 3102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:40:59.939657 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.939660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.939662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940154 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.940509 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:40:59.940512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:40:59.940514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:40:59.940666 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:40:59.941176 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:40:59.941183 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:40:59.941617 (+ 434us) client_negotiation.cc:769] Sending connection context
0809 15:40:59.942418 (+ 801us) client_negotiation.cc:240] Negotiation successful
0809 15:40:59.942932 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":425,"spinlock_wait_cycles":59392,"thread_start_us":229,"threads_started":1}
I20260809 15:40:59.945547 25116 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:40:59.945583 25115 heartbeater.cc:347] Connected to a master server at 127.14.15.188:42755
I20260809 15:40:59.945567 25117 heartbeater.cc:347] Connected to a master server at 127.14.15.189:41923
I20260809 15:40:59.945806 25115 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.945806 25116 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.945806 25117 heartbeater.cc:464] Registering TS with master...
I20260809 15:40:59.946470 25115 heartbeater.cc:511] Master 127.14.15.188:42755 requested a full tablet report, sending...
I20260809 15:40:59.946475 25117 heartbeater.cc:511] Master 127.14.15.189:41923 requested a full tablet report, sending...
I20260809 15:40:59.946482 25116 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
I20260809 15:40:59.947643 23520 ts_manager.cc:194] Re-registered known tserver with Master: 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:40:59.947813 24671 ts_manager.cc:194] Registered new tserver with Master: 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:40:59.948328 24388 ts_manager.cc:194] Registered new tserver with Master: 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:40:59.948437 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:56683
I20260809 15:40:59.950344 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:45993
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:39441
--webserver_port=40143
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:00.068737 25126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:00.069011 25126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:00.069056 25126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:00.073208 25126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:00.073271 25126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:00.073331 25126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:00.078819 25126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:45993
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=40143
--tserver_master_addrs=127.14.15.190:39441,127.14.15.189:41923,127.14.15.188:42755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:00.079879 25126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:00.080901 25126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:41:00.090348 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.085841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51486 (local address 127.14.15.188:42755)
0809 15:41:00.085975 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.085980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.086078 (+ 98us) server_negotiation.cc:407] Connection header received
0809 15:41:00.086281 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.086284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.086371 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.086479 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.086933 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.087722 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.089269 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.089691 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.089781 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.089894 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.090122 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.090203 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:41:00.090353 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.085705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51486)
0809 15:41:00.085976 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.085993 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.086143 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.086523 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.086527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.086554 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.086700 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.086712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.087891 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.087894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.089146 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.089156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.089832 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.089838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.089949 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.089978 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.090069 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.090163 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":91,"threads_started":1}
I20260809 15:41:00.091051 24687 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 15:41:00.091532 24729 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931362268fa64fb382652b560da8480f. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:41:00.091694 24729 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: LEARNER
W20260809 15:41:00.091929 25134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:00.092054 25135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:00.092326 25138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:00.092792 25126 server_base.cc:1034] running on GCE node
I20260809 15:41:00.093214 25126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:00.093816 25126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:00.095006 25126 hybrid_clock.cc:648] HybridClock initialized: now 1786290060094948 us; error 69 us; skew 500 ppm
Aug 09 15:41:00 dist-test-slave-jztv krb5kdc[23451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290060, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:00.098097 25126 init.cc:377] Logged in from keytab as oryx/127.14.15.131@KRBTEST.COM (short username oryx)
I20260809 15:41:00.099030 25126 webserver.cc:460] Webserver started at http://127.14.15.131:40143/ using document root <none> and password file <none>
I20260809 15:41:00.099592 25126 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:00.099666 25126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:00.103598 25126 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:41:00.105679 25152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:00.107396 25126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:00.107515 25126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "15385e6d58494bb79f7b060b0ca2ef77"
format_stamp: "Formatted at 2026-08-09 15:40:58 on dist-test-slave-jztv"
server_key: "1ebdd998030f9cdfcef8afef21cdfe89"
server_key_iv: "eb79d9862f8bf0f9a1d5f6e990f90e93"
server_key_version: "encryptionkey@0"
I20260809 15:41:00.108083 25126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:00.150867 25126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:00.154453 25126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:00.154662 25126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:00.155311 25126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:00.156219 25126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:00.156270 25126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:00.156329 25126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:00.156363 25126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:00.172983 25126 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45993
I20260809 15:41:00.173007 25311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45993 every 8 connection(s)
I20260809 15:41:00.174263 25126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:00.178571 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 25126
Aug 09 15:41:00 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290060, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.188@KRBTEST.COM
Aug 09 15:41:00 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290060, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
Aug 09 15:41:00 dist-test-slave-jztv krb5kdc[23451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290060, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.189@KRBTEST.COM
I20260809 15:41:00.194118 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.178235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:33453 (local address 127.14.15.188:42755)
0809 15:41:00.180713 (+ 2478us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.180718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.180734 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:41:00.180781 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.180787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.180849 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.180926 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.181525 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.182337 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.183470 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.183875 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.183984 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.189304 (+ 5320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.189312 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.189315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.189344 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.191464 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.192142 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.192149 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.192154 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.192248 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.192748 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.192754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.192757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.192988 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.193083 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.193788 (+ 705us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.193917 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2382}
I20260809 15:41:00.195511 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.176647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:45823)
0809 15:41:00.177554 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.177601 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.178627 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.179414 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.179427 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.179990 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:00.180690 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.180712 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.181873 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.181876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.183273 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.183283 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.184180 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.184187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.184895 (+ 708us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.186544 (+ 1649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:00.186588 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:00.190581 (+ 3993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:00.192704 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.192706 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.192708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.192987 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.193316 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.193319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.193320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.193401 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.193863 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:00.193865 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:00.193946 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.194270 (+ 324us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.194409 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":3,"thread_start_us":564,"threads_started":1}
I20260809 15:41:00.195511 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.178062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.14.15.131:33453)
0809 15:41:00.178367 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.178382 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.178635 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.181041 (+ 2406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.181043 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.181268 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:00.181386 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.181393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.182469 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.182472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.183341 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.183352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.184184 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.184189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.184459 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.185128 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:00.185148 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:00.188382 (+ 3234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:00.191614 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.191623 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.191644 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.192016 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.192359 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.192362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.192364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.192568 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.193138 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:00.193145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:00.193492 (+ 347us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.193732 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.194103 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":36,"thread_start_us":102,"threads_started":1}
I20260809 15:41:00.196468 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.176213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:45823 (local address 127.14.15.190:39441)
0809 15:41:00.176374 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.176379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.177710 (+ 1331us) server_negotiation.cc:407] Connection header received
0809 15:41:00.178909 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.178913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.178979 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.179042 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.180869 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.181698 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.183393 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.183860 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.183985 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.190720 (+ 6735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.190724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.190726 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.190751 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.192593 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.193122 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.193125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.193127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.193210 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.193507 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.193510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.193512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.193719 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.193808 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.194151 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.196302 (+ 2151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2060,"server-negotiator.queue_time_us":55}
I20260809 15:41:00.196736 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.181615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.14.15.190:39441)
0809 15:41:00.181842 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.181846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.181987 (+ 141us) server_negotiation.cc:407] Connection header received
0809 15:41:00.182151 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.182156 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.182236 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.183176 (+ 940us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.183260 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.184133 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.185447 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.185805 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.186295 (+ 490us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.188162 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.188166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.188169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.188196 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.190258 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.190807 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.190810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.190813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.190918 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.191280 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.191285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.191287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.191528 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.192381 (+ 853us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.192459 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.196600 (+ 4141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
I20260809 15:41:00.196996 25312 heartbeater.cc:347] Connected to a master server at 127.14.15.188:42755
I20260809 15:41:00.197273 25312 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:00.197882 25313 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39441
I20260809 15:41:00.197907 25312 heartbeater.cc:511] Master 127.14.15.188:42755 requested a full tablet report, sending...
I20260809 15:41:00.197969 25313 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:00.198112 25313 heartbeater.cc:511] Master 127.14.15.190:39441 requested a full tablet report, sending...
I20260809 15:41:00.198127 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.178937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:55419 (local address 127.14.15.189:41923)
0809 15:41:00.179069 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.179073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.186442 (+ 7369us) server_negotiation.cc:407] Connection header received
0809 15:41:00.186603 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.186606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.186657 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.186708 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.187442 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.188152 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.189175 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.189539 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.189678 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.193194 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.193198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.193201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.193228 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.196018 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.196595 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.196602 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.196607 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.196711 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.197124 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.197127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.197129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.197340 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.197410 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.197819 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.197964 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:41:00.198815 25325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.178525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.14.15.131:55419)
0809 15:41:00.186315 (+ 7790us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.186374 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.186472 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.186844 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.186847 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.187195 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:00.187309 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.187317 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.188280 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.188283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.189058 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.189073 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.189844 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.189850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.189969 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.191421 (+ 1452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:00.191439 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:00.193032 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:00.196159 (+ 3127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.196162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.196163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.196425 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.196904 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:00.196906 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:00.196908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:00.197006 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:00.197489 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:00.197491 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:00.197602 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.198403 (+ 801us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.198585 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7720,"thread_start_us":147,"threads_started":1}
I20260809 15:41:00.199213 23520 ts_manager.cc:194] Re-registered known tserver with Master: 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:41:00.199385 24671 ts_manager.cc:194] Registered new tserver with Master: 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:41:00.199896 23520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:45823
I20260809 15:41:00.200305 25316 heartbeater.cc:347] Connected to a master server at 127.14.15.189:41923
I20260809 15:41:00.200409 25316 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:00.200603 25316 heartbeater.cc:511] Master 127.14.15.189:41923 requested a full tablet report, sending...
I20260809 15:41:00.201339 24388 ts_manager.cc:194] Registered new tserver with Master: 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:41:00.202415 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.181535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51488 (local address 127.14.15.188:42755)
0809 15:41:00.182378 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.182382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.184307 (+ 1925us) server_negotiation.cc:407] Connection header received
0809 15:41:00.184349 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.184351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.184396 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.184483 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.185731 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.191239 (+ 5508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.194100 (+ 2861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.194482 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.194594 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.196239 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.196245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.196251 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.196276 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.200533 (+ 4257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.200999 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.201002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.201004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.201109 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.201411 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.201415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.201417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.201645 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.201768 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.202042 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.202190 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":109,"threads_started":1}
I20260809 15:41:00.200093 23519 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:00.204231 23519 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:00.207445 25343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: NON_VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: true } } }
I20260809 15:41:00.207599 25343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:00.207813 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.180897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52694 (local address 127.14.15.189:41923)
0809 15:41:00.183533 (+ 2636us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.183538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.183550 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:41:00.183673 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.183677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.183740 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.183850 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.185376 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.186286 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.187617 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.188027 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.188117 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.190016 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.190021 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.190024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.190054 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.205448 (+ 15394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.205934 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.205937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.205939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.206046 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.206477 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.206480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.206481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.206662 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.206763 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.207427 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.207578 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2559,"thread_start_us":76,"threads_started":1}
I20260809 15:41:00.210881 25344 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: attempting to promote NON_VOTER d0169e5eaba846a1a500c9062f5176fa to VOTER
I20260809 15:41:00.211338 25344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:00.212446 24402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 15:41:00.212597 24687 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 LEARNER]: Refusing update from remote peer 931362268fa64fb382652b560da8480f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 15:41:00.212874 24322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 15:41:00.213330 24322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 15:41:00.215245 24402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d0169e5eaba846a1a500c9062f5176fa (127.14.15.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.215322 24322 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d0169e5eaba846a1a500c9062f5176fa (127.14.15.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.216176 24687 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d0169e5eaba846a1a500c9062f5176fa (127.14.15.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.216867 24322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.216972 24322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:00.217118 24322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.217196 24322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:00.217173 25344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.217280 25344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:00.217726 25353 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.217826 25353 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:41:00.218499 24729 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "931362268fa64fb382652b560da8480f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:00.218612 24729 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:41:00.228132 25355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.221551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:40209 (local address 127.0.0.1:38686)
0809 15:41:00.222914 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.222925 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.223041 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.223588 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.223591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.223615 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.223740 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.223747 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.225182 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.225185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.226327 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.226338 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.227660 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.227664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.227770 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.227802 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.227881 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.227969 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1300,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260809 15:41:00.228176 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.222373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38686 (local address 127.14.15.129:40209)
0809 15:41:00.222776 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.222796 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.223017 (+ 221us) server_negotiation.cc:407] Connection header received
0809 15:41:00.223164 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.223171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.223425 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.223609 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.223896 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.225030 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.226467 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.227517 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.227637 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.227795 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.227913 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.228033 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":102,"threads_started":1}
I20260809 15:41:00.229405 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.221248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45993 (local address 127.0.0.1:37298)
0809 15:41:00.221830 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.221845 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.221925 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.225118 (+ 3193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.225121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.225140 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.225234 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.225241 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.226890 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.226897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.227700 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.227709 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.229005 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.229009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.229109 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.229136 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.229195 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.229272 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":3}
I20260809 15:41:00.229635 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.221885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42491 (local address 127.0.0.1:38626)
0809 15:41:00.223223 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.223235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.223314 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.224368 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.224372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.224393 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.224487 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.224492 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.225817 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.225821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.227021 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.227033 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.229235 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.229239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.229326 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.229348 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.229413 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.229489 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"thread_start_us":110,"threads_started":1}
I20260809 15:41:00.230125 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.221431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37298 (local address 127.14.15.131:45993)
0809 15:41:00.224657 (+ 3226us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.224674 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.224696 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:41:00.224773 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.224778 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.224956 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.225382 (+ 426us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.225516 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.226434 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.227851 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.228857 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.229711 (+ 854us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.229848 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.229900 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.229989 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3094,"thread_start_us":151,"threads_started":1}
I20260809 15:41:00.230345 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.222069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38626 (local address 127.14.15.130:42491)
0809 15:41:00.222436 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.222450 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.223839 (+ 1389us) server_negotiation.cc:407] Connection header received
0809 15:41:00.224022 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.224028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.224228 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.224356 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.224621 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.225693 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.227273 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.229111 (+ 1838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.229235 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.229379 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.229440 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.230136 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":195,"threads_started":1}
I20260809 15:41:00.231835 24824 tablet_service.cc:1467] Processing CreateTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 (DEFAULT_TABLE table=test-table [id=1790554de6a9405c8416e203ef620b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:00.233055 24824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c038db08a5546d5ba3b55d8215fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:00.232782 25194 tablet_service.cc:1467] Processing CreateTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 (DEFAULT_TABLE table=test-table [id=1790554de6a9405c8416e203ef620b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:00.232971 25017 tablet_service.cc:1467] Processing CreateTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 (DEFAULT_TABLE table=test-table [id=1790554de6a9405c8416e203ef620b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:00.233844 25194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c038db08a5546d5ba3b55d8215fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:00.233960 25017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c038db08a5546d5ba3b55d8215fc8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:00.242591 25365 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Bootstrap starting.
I20260809 15:41:00.242661 25362 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Bootstrap starting.
I20260809 15:41:00.242861 25363 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Bootstrap starting.
I20260809 15:41:00.244983 25362 tablet_bootstrap.cc:654] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:00.244983 25365 tablet_bootstrap.cc:654] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:00.245002 25363 tablet_bootstrap.cc:654] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:00.245867 25363 log.cc:824] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:00.245870 25365 log.cc:824] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:00.245870 25362 log.cc:824] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:00.248227 25362 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: No bootstrap required, opened a new log
I20260809 15:41:00.248303 25365 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: No bootstrap required, opened a new log
I20260809 15:41:00.248454 25365 ts_tablet_manager.cc:1397] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 15:41:00.248456 25362 ts_tablet_manager.cc:1397] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 15:41:00.252017 25363 tablet_bootstrap.cc:492] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: No bootstrap required, opened a new log
I20260809 15:41:00.252214 25363 ts_tablet_manager.cc:1397] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.005s
I20260809 15:41:00.252645 25365 raft_consensus.cc:348] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.252645 25362 raft_consensus.cc:348] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.252921 25362 raft_consensus.cc:374] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:00.252921 25365 raft_consensus.cc:374] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:00.252975 25362 raft_consensus.cc:729] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad54bf5e19a444fb3fa48cebf2b4851, State: Initialized, Role: FOLLOWER
I20260809 15:41:00.252998 25365 raft_consensus.cc:729] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286f0962394b4fa89f88f74f812948f8, State: Initialized, Role: FOLLOWER
I20260809 15:41:00.253474 25362 consensus_queue.cc:260] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.253530 25365 consensus_queue.cc:260] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.254551 25365 ts_tablet_manager.cc:1428] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260809 15:41:00.254565 25362 ts_tablet_manager.cc:1428] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260809 15:41:00.255725 25116 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
I20260809 15:41:00.256892 25363 raft_consensus.cc:348] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.257158 25363 raft_consensus.cc:374] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:00.257206 25363 raft_consensus.cc:729] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15385e6d58494bb79f7b060b0ca2ef77, State: Initialized, Role: FOLLOWER
I20260809 15:41:00.257682 25363 consensus_queue.cc:260] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.258297 24920 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
I20260809 15:41:00.260694 25313 heartbeater.cc:503] Master 127.14.15.190:39441 was elected leader, sending a full tablet report...
I20260809 15:41:00.260911 25363 ts_tablet_manager.cc:1428] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260809 15:41:00.388605 25370 raft_consensus.cc:482] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:00.388865 25370 raft_consensus.cc:504] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.390105 25370 leader_election.cc:288] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993), 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:41:00.394094 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.390442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41843 (local address 127.14.15.131:45993)
0809 15:41:00.390618 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.390625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.391037 (+ 412us) server_negotiation.cc:407] Connection header received
0809 15:41:00.391155 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.391158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.391211 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.391287 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.391582 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.392075 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393099 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.393479 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393607 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.393664 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.393877 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.393952 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 15:41:00.394122 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.390475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45993 (local address 127.14.15.129:41843)
0809 15:41:00.390893 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.390908 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.391038 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.391329 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.391335 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.391358 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.391465 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.391470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.392192 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.392197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.392968 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.392977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.393607 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.393756 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.393775 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.393858 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.393930 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":34,"thread_start_us":136,"threads_started":1}
I20260809 15:41:00.394146 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.390497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:39053 (local address 127.14.15.130:42491)
0809 15:41:00.390638 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.390642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.390901 (+ 259us) server_negotiation.cc:407] Connection header received
0809 15:41:00.391025 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.391028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.391082 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.391162 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:00.391493 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.391997 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393164 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.393553 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393685 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.393742 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.393956 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.394027 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:41:00.394163 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.390426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42491 (local address 127.14.15.129:39053)
0809 15:41:00.390788 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:00.390809 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:00.390923 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:00.391185 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:00.391188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:00.391204 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:00.391356 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.391366 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.392108 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.392115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.393027 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:00.393039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.393682 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.393685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:00.393825 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.393844 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 15:41:00.393926 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:41:00.393998 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":2,"thread_start_us":159,"threads_started":1}
I20260809 15:41:00.394809 25052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c038db08a5546d5ba3b55d8215fc8d2" candidate_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286f0962394b4fa89f88f74f812948f8" is_pre_election: true
I20260809 15:41:00.394850 25244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c038db08a5546d5ba3b55d8215fc8d2" candidate_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15385e6d58494bb79f7b060b0ca2ef77" is_pre_election: true
I20260809 15:41:00.395130 25244 raft_consensus.cc:2454] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad54bf5e19a444fb3fa48cebf2b4851 in term 0.
I20260809 15:41:00.395131 25052 raft_consensus.cc:2454] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad54bf5e19a444fb3fa48cebf2b4851 in term 0.
I20260809 15:41:00.395596 24761 leader_election.cc:302] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 15385e6d58494bb79f7b060b0ca2ef77, 286f0962394b4fa89f88f74f812948f8, bad54bf5e19a444fb3fa48cebf2b4851; no voters:
I20260809 15:41:00.395877 25370 raft_consensus.cc:2781] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:00.395967 25370 raft_consensus.cc:482] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:00.396011 25370 raft_consensus.cc:3037] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:00.397188 25370 raft_consensus.cc:504] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.397593 25370 leader_election.cc:288] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [CANDIDATE]: Term 1 election: Requested vote from peers 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993), 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491)
I20260809 15:41:00.397933 25244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c038db08a5546d5ba3b55d8215fc8d2" candidate_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15385e6d58494bb79f7b060b0ca2ef77"
I20260809 15:41:00.398015 25052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c038db08a5546d5ba3b55d8215fc8d2" candidate_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286f0962394b4fa89f88f74f812948f8"
I20260809 15:41:00.398087 25244 raft_consensus.cc:3037] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:00.398175 25052 raft_consensus.cc:3037] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:00.399200 25244 raft_consensus.cc:2454] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad54bf5e19a444fb3fa48cebf2b4851 in term 1.
I20260809 15:41:00.399523 24761 leader_election.cc:302] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15385e6d58494bb79f7b060b0ca2ef77, bad54bf5e19a444fb3fa48cebf2b4851; no voters:
I20260809 15:41:00.399719 25370 raft_consensus.cc:2781] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:00.399818 25052 raft_consensus.cc:2454] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad54bf5e19a444fb3fa48cebf2b4851 in term 1.
I20260809 15:41:00.399967 25370 raft_consensus.cc:686] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 LEADER]: Becoming Leader. State: Replica: bad54bf5e19a444fb3fa48cebf2b4851, State: Running, Role: LEADER
I20260809 15:41:00.400334 25370 consensus_queue.cc:237] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } }
I20260809 15:41:00.403811 23518 catalog_manager.cc:5495] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 reported cstate change: term changed from 0 to 1, leader changed from <none> to bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } health_report { overall_health: UNKNOWN } } }
I20260809 15:41:00.418630 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.415375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38698 (local address 127.14.15.129:40209)
0809 15:41:00.415501 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.415504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.415518 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:00.415654 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.415656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.415707 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.415793 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:00.415987 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.416475 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.417251 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.417462 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.417536 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.417788 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:00.418194 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:00.418346 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.418410 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.418460 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:41:00.424611 25052 raft_consensus.cc:1261] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Refusing update from remote peer bad54bf5e19a444fb3fa48cebf2b4851: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:00.424618 25244 raft_consensus.cc:1261] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Refusing update from remote peer bad54bf5e19a444fb3fa48cebf2b4851: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:00.425330 25376 consensus_queue.cc:1035] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:00.425539 25370 consensus_queue.cc:1035] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:41:00.426200 25320 tablet.cc:2369] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:41:00.426241 25119 tablet.cc:2369] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:41:00.436537 25382 mvcc.cc:205] Tried to move back new op lower bound from 7316644087492345856 to 7316644087402311680. Current Snapshot: MvccSnapshot[applied={T|T < 7316644087492345856}]
I20260809 15:41:00.442307 25381 mvcc.cc:205] Tried to move back new op lower bound from 7316644087492345856 to 7316644087402311680. Current Snapshot: MvccSnapshot[applied={T|T < 7316644087492345856}]
I20260809 15:41:00.443660 23518 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:00.443794 23518 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:00.447760 23518 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 931362268fa64fb382652b560da8480f: Sending DeleteTablet for 3 replicas of tablet 6c038db08a5546d5ba3b55d8215fc8d2
I20260809 15:41:00.448410 25194 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:00 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37298
I20260809 15:41:00.449407 24824 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:00 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:38686
I20260809 15:41:00.449512 25017 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c038db08a5546d5ba3b55d8215fc8d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:00 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:38626
I20260809 15:41:00.449908 25391 tablet_replica.cc:330] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: stopping tablet replica
I20260809 15:41:00.450259 25391 raft_consensus.cc:2229] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:00.450392 25390 tablet_replica.cc:330] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: stopping tablet replica
I20260809 15:41:00.450687 25390 raft_consensus.cc:2229] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:00.450728 25391 raft_consensus.cc:2258] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:00.450965 25390 raft_consensus.cc:2258] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:00.452050 25392 tablet_replica.cc:330] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: stopping tablet replica
I20260809 15:41:00.452210 25391 ts_tablet_manager.cc:1905] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:00.452343 25392 raft_consensus.cc:2229] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:00.452637 25392 raft_consensus.cc:2258] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:00.453759 25392 ts_tablet_manager.cc:1905] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:00.455199 25391 ts_tablet_manager.cc:1918] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:00.455304 25391 log.cc:1196] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/6c038db08a5546d5ba3b55d8215fc8d2
I20260809 15:41:00.455695 25391 ts_tablet_manager.cc:1939] T 6c038db08a5546d5ba3b55d8215fc8d2 P bad54bf5e19a444fb3fa48cebf2b4851: Deleting consensus metadata
I20260809 15:41:00.456007 25392 ts_tablet_manager.cc:1918] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:00.456115 25392 log.cc:1196] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/6c038db08a5546d5ba3b55d8215fc8d2
I20260809 15:41:00.456379 25392 ts_tablet_manager.cc:1939] T 6c038db08a5546d5ba3b55d8215fc8d2 P 286f0962394b4fa89f88f74f812948f8: Deleting consensus metadata
I20260809 15:41:00.456997 23501 catalog_manager.cc:4841] TS bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209): tablet 6c038db08a5546d5ba3b55d8215fc8d2 (table test-table [id=1790554de6a9405c8416e203ef620b5c]) successfully deleted
I20260809 15:41:00.457173 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 23472
I20260809 15:41:00.467577 25390 ts_tablet_manager.cc:1905] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:00.471033 25390 ts_tablet_manager.cc:1918] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:00.471168 25390 log.cc:1196] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/6c038db08a5546d5ba3b55d8215fc8d2
I20260809 15:41:00.471544 25390 ts_tablet_manager.cc:1939] T 6c038db08a5546d5ba3b55d8215fc8d2 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting consensus metadata
I20260809 15:41:00.473953 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.451676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52708 (local address 127.14.15.189:41923)
0809 15:41:00.451892 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.451896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.459717 (+ 7821us) server_negotiation.cc:407] Connection header received
0809 15:41:00.459994 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.460001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.460073 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.460144 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.461476 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.462102 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.463050 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.463314 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.463377 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.469793 (+ 6416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.469801 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.469808 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.469846 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.471941 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.472549 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.472553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.472555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.472659 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.473010 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.473013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.473015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.473228 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.473377 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.473629 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.473763 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
W20260809 15:41:00.474972 24957 connection.cc:535] server connection from 127.0.0.1:38626 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 15:41:00.475867 25158 connection.cc:535] server connection from 127.0.0.1:37298 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:41:00.484654 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.451472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.14.15.188:42755)
0809 15:41:00.451806 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.451810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.474613 (+ 22803us) server_negotiation.cc:407] Connection header received
0809 15:41:00.474812 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.474815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.474876 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.474932 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.476423 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.477095 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.478176 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.478600 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.478714 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.480433 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.480437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.480440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.480469 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.482143 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.482677 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.482680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.482682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.482765 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.483071 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.483074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.483076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.483281 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.483416 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.484297 (+ 881us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.484478 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250}
I20260809 15:41:00.489060 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.477932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.14.15.189:41923)
0809 15:41:00.478040 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.478077 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.478999 (+ 922us) server_negotiation.cc:407] Connection header received
0809 15:41:00.479178 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.479181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.479238 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.479294 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.480702 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.481459 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.482913 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.483243 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.483316 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.485409 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.485413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.485416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.485442 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.487253 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.487721 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.487725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.487726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.487811 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.488107 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.488114 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.488116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.488365 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.488486 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.488781 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.488901 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:41:00.489835 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:00.478598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.14.15.188:42755)
0809 15:41:00.478714 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:00.478718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:00.479259 (+ 541us) server_negotiation.cc:407] Connection header received
0809 15:41:00.479440 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:00.479443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:00.479489 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:00.479546 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:00.480703 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.481464 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.482780 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:00.483108 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:00.483181 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:00.485710 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:00.485714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:00.485716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:00.485740 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:00.487523 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.488058 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.488062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.488064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.488147 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:00.488434 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:00.488437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:00.488439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:00.488635 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:00.488758 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:00.489562 (+ 804us) server_negotiation.cc:299] Negotiation successful
0809 15:41:00.489678 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:41:01.437844 25402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.437284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:43377)
0809 15:41:01.437609 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.437723 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":94,"threads_started":1}
W20260809 15:41:01.438198 25313 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:39441 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.441108 25403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.440634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:52873)
0809 15:41:01.440901 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.441006 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":72,"threads_started":1}
W20260809 15:41:01.441439 24920 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:39441 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.442129 25405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.441729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:39827)
0809 15:41:01.441979 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.442051 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":61,"threads_started":1}
W20260809 15:41:01.442447 25116 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:39441 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.949133 25406 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 931362268fa64fb382652b560da8480f)
I20260809 15:41:01.949287 25407 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 931362268fa64fb382652b560da8480f)
I20260809 15:41:01.949420 25406 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:01.949440 25407 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:01.950659 25406 leader_election.cc:288] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), dff0ad13c1f54ed882b865c2f314262b (127.14.15.189:41923)
I20260809 15:41:01.950875 25407 leader_election.cc:288] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755)
I20260809 15:41:01.951181 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.950701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46270)
0809 15:41:01.951000 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.951081 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":67,"threads_started":1}
I20260809 15:41:01.951284 25409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.950134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46254)
0809 15:41:01.951103 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.951186 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":893,"thread_start_us":91,"threads_started":1}
W20260809 15:41:01.951359 24641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
W20260809 15:41:01.951416 24360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.952301 25409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.952040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46284)
0809 15:41:01.952192 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.952239 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260809 15:41:01.952450 24360 leader_election.cc:334] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.952785 25411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.952139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46294)
0809 15:41:01.952661 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.952716 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457}
W20260809 15:41:01.952919 24641 leader_election.cc:334] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.955422 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.950982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41923 (local address 127.0.0.1:52730)
0809 15:41:01.951332 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.951346 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:01.951448 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:01.952196 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:01.952201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:01.952224 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:01.952352 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:01.952361 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.953492 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.953495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:01.954368 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:01.954378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.955012 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.955015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:01.955113 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:01.955141 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:41:01.955229 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:41:01.955301 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":65,"threads_started":1}
I20260809 15:41:01.955422 25420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.951631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.14.15.189:41923)
0809 15:41:01.951875 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:01.951885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:01.951900 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:41:01.951949 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:01.951955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:01.952021 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:01.952475 (+ 454us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:01.952589 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.953371 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.954487 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.954889 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.955017 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:01.955080 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:01.955245 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 15:41:01.955311 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260809 15:41:01.955770 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.950584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42755 (local address 127.0.0.1:51514)
0809 15:41:01.951796 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.951812 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:01.951905 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:01.952432 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:01.952435 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:01.952453 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:01.952591 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:01.952600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.953815 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.953818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:01.954680 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:01.954690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.955331 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.955335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:01.955426 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:01.955451 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:41:01.955545 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:41:01.955636 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"mutex_wait_us":1,"spinlock_wait_cycles":3840,"thread_start_us":58,"threads_started":1}
I20260809 15:41:01.955796 25413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.951209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51514 (local address 127.14.15.188:42755)
0809 15:41:01.952081 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:01.952099 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:01.952112 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:41:01.952154 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:01.952158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:01.952199 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:01.952302 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:01.952694 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.953703 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.954798 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:01.955212 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:01.955328 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:01.955386 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:01.955600 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 15:41:01.955685 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":72,"threads_started":1}
I20260809 15:41:01.955932 24402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0169e5eaba846a1a500c9062f5176fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dff0ad13c1f54ed882b865c2f314262b" is_pre_election: true
I20260809 15:41:01.956158 24402 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0169e5eaba846a1a500c9062f5176fa in term 1.
I20260809 15:41:01.956240 24687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dff0ad13c1f54ed882b865c2f314262b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0169e5eaba846a1a500c9062f5176fa" is_pre_election: true
I20260809 15:41:01.956456 24687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dff0ad13c1f54ed882b865c2f314262b in term 1.
I20260809 15:41:01.956578 24645 leader_election.cc:302] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0169e5eaba846a1a500c9062f5176fa, dff0ad13c1f54ed882b865c2f314262b; no voters: 931362268fa64fb382652b560da8480f
I20260809 15:41:01.956791 25406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 15:41:01.956863 25406 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 931362268fa64fb382652b560da8480f)
I20260809 15:41:01.956920 25406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:41:01.957053 24360 leader_election.cc:302] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0169e5eaba846a1a500c9062f5176fa, dff0ad13c1f54ed882b865c2f314262b; no voters: 931362268fa64fb382652b560da8480f
I20260809 15:41:01.957216 25407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 15:41:01.957278 25407 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 931362268fa64fb382652b560da8480f)
I20260809 15:41:01.957351 25407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:41:01.958145 25406 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:01.958494 25407 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:01.958566 25406 leader_election.cc:288] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 election: Requested vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), dff0ad13c1f54ed882b865c2f314262b (127.14.15.189:41923)
I20260809 15:41:01.958842 25407 leader_election.cc:288] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 election: Requested vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755)
I20260809 15:41:01.958900 24402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0169e5eaba846a1a500c9062f5176fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dff0ad13c1f54ed882b865c2f314262b"
I20260809 15:41:01.959023 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.958681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46298)
0809 15:41:01.958858 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.958940 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 15:41:01.959079 24402 raft_consensus.cc:2379] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d0169e5eaba846a1a500c9062f5176fa in current term 2: Already voted for candidate dff0ad13c1f54ed882b865c2f314262b in this term.
I20260809 15:41:01.959605 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.959379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46300)
0809 15:41:01.959489 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.959539 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 15:41:01.959702 24687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dff0ad13c1f54ed882b865c2f314262b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0169e5eaba846a1a500c9062f5176fa"
I20260809 15:41:01.959806 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.959536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46306)
0809 15:41:01.959691 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.959743 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 15:41:01.959867 24687 raft_consensus.cc:2379] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dff0ad13c1f54ed882b865c2f314262b in current term 2: Already voted for candidate d0169e5eaba846a1a500c9062f5176fa in this term.
W20260809 15:41:01.959894 24641 leader_election.cc:334] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.959959 24641 leader_election.cc:302] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0169e5eaba846a1a500c9062f5176fa; no voters: 931362268fa64fb382652b560da8480f, dff0ad13c1f54ed882b865c2f314262b
I20260809 15:41:01.960194 25406 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 15:41:01.960409 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:01.960173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46312)
0809 15:41:01.960293 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:01.960352 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:41:01.960525 24360 leader_election.cc:334] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:01.960602 24360 leader_election.cc:302] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dff0ad13c1f54ed882b865c2f314262b; no voters: 931362268fa64fb382652b560da8480f, d0169e5eaba846a1a500c9062f5176fa
I20260809 15:41:01.960732 25407 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 15:41:02.439502 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:02.438984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:51365)
0809 15:41:02.439269 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:02.439360 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":118,"threads_started":1}
I20260809 15:41:02.442552 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:02.442103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:58499)
0809 15:41:02.442384 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:02.442451 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":110,"threads_started":1}
I20260809 15:41:02.443287 25425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:02.442929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:51369)
0809 15:41:02.443166 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:02.443216 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260809 15:41:03.441112 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.440580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:33409)
0809 15:41:03.440901 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.440984 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":95,"threads_started":1}
I20260809 15:41:03.443861 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.443382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:36965)
0809 15:41:03.443682 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.443758 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":71,"threads_started":1}
I20260809 15:41:03.444262 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.443823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:38171)
0809 15:41:03.444107 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.444177 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":69,"threads_started":1}
I20260809 15:41:03.802874 25430 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:03.803015 25430 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:03.803489 25430 leader_election.cc:288] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755)
I20260809 15:41:03.804080 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.803699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46574)
0809 15:41:03.803902 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.803973 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260809 15:41:03.804262 24687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dff0ad13c1f54ed882b865c2f314262b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0169e5eaba846a1a500c9062f5176fa" is_pre_election: true
I20260809 15:41:03.804420 24687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dff0ad13c1f54ed882b865c2f314262b in term 2.
I20260809 15:41:03.804901 24360 leader_election.cc:302] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0169e5eaba846a1a500c9062f5176fa, dff0ad13c1f54ed882b865c2f314262b; no voters:
I20260809 15:41:03.804993 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.804748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46576)
0809 15:41:03.804849 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.804895 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 15:41:03.805074 24360 leader_election.cc:334] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:03.805150 25430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 15:41:03.805240 25430 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:03.805295 25430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:41:03.806412 25430 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:03.806753 25430 leader_election.cc:288] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 election: Requested vote from peers 931362268fa64fb382652b560da8480f (127.14.15.190:39441), d0169e5eaba846a1a500c9062f5176fa (127.14.15.188:42755)
I20260809 15:41:03.807123 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.806874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46580)
0809 15:41:03.806997 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.807057 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 15:41:03.807328 24687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dff0ad13c1f54ed882b865c2f314262b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0169e5eaba846a1a500c9062f5176fa"
I20260809 15:41:03.807457 24687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:41:03.807720 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.807512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46586)
0809 15:41:03.807625 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.807675 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 15:41:03.807816 24360 leader_election.cc:334] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
I20260809 15:41:03.808516 24687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dff0ad13c1f54ed882b865c2f314262b in term 3.
I20260809 15:41:03.808826 24360 leader_election.cc:302] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0169e5eaba846a1a500c9062f5176fa, dff0ad13c1f54ed882b865c2f314262b; no voters: 931362268fa64fb382652b560da8480f
I20260809 15:41:03.809012 25430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:41:03.809186 25430 raft_consensus.cc:686] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [term 3 LEADER]: Becoming Leader. State: Replica: dff0ad13c1f54ed882b865c2f314262b, State: Running, Role: LEADER
I20260809 15:41:03.809448 25430 consensus_queue.cc:237] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } }
I20260809 15:41:03.810892 25440 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: New leader dff0ad13c1f54ed882b865c2f314262b. Latest consensus state: current_term: 3 leader_uuid: "dff0ad13c1f54ed882b865c2f314262b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:03.811220 25440 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:03.811592 25444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:03.814299 25444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:03.814813 25444 catalog_manager.cc:1259] Loaded cluster ID: 0c33b6f09d504a0997934c9cff1146a4
I20260809 15:41:03.814913 25444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:03.815526 25444 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:03.815922 25444 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Loaded TSK: 0
I20260809 15:41:03.816593 25444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:41:03.872400 24384 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:03.875568 24384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:03.879025 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.878775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46596)
0809 15:41:03.878906 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.878956 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 15:41:03.879022 24687 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [term 3 FOLLOWER]: Refusing update from remote peer dff0ad13c1f54ed882b865c2f314262b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 15:41:03.879679 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.879475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.0.0.1:46604)
0809 15:41:03.879578 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.879625 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 15:41:03.879706 25430 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 15:41:03.879868 24360 consensus_peers.cc:487] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b -> Peer 931362268fa64fb382652b560da8480f (127.14.15.190:39441): Couldn't send request to peer 931362268fa64fb382652b560da8480f. Status: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 15:41:03.881234 25448 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader dff0ad13c1f54ed882b865c2f314262b. Latest consensus state: current_term: 3 leader_uuid: "dff0ad13c1f54ed882b865c2f314262b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:03.881366 25448 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:41:03.882737 25430 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "dff0ad13c1f54ed882b865c2f314262b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:03.882889 25430 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:03.882992 25448 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "dff0ad13c1f54ed882b865c2f314262b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "931362268fa64fb382652b560da8480f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39441 } } peers { permanent_uuid: "dff0ad13c1f54ed882b865c2f314262b" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41923 } attrs { promote: false } } peers { permanent_uuid: "d0169e5eaba846a1a500c9062f5176fa" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42755 } attrs { promote: false } } }
I20260809 15:41:03.883097 25448 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0169e5eaba846a1a500c9062f5176fa [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:41:03.893638 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.888658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:40209 (local address 127.0.0.1:38704)
0809 15:41:03.889179 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.889196 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:03.889297 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:03.889703 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:03.889706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:03.889725 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:03.889854 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.889864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.891030 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.891033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.892241 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.892251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.893152 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.893156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.893292 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.893323 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:41:03.893408 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 15:41:03.893484 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":17}
I20260809 15:41:03.893682 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.888776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38704 (local address 127.14.15.129:40209)
0809 15:41:03.889044 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.889049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.889436 (+ 387us) server_negotiation.cc:407] Connection header received
0809 15:41:03.889505 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.889510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.889568 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.889969 (+ 401us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:03.890095 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.890914 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.892374 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.892996 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.893120 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.893212 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.893435 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.893530 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":71,"threads_started":1}
I20260809 15:41:03.893821 25458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.888891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42491 (local address 127.0.0.1:38636)
0809 15:41:03.889751 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.889764 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:03.889836 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:03.890328 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:03.890333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:03.890354 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:03.890460 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.890465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.891298 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.891301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.892414 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.892422 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.893328 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.893331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.893433 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.893464 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:41:03.893558 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:41:03.893626 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":113,"threads_started":1}
I20260809 15:41:03.893823 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.889546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.14.15.130:42491)
0809 15:41:03.890046 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.890050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.890066 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:41:03.890113 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.890117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.890162 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.890322 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:03.890545 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.891218 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.892506 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.893121 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.893206 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.893267 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.893581 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.893664 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":68,"threads_started":1}
I20260809 15:41:03.894541 24824 tablet_service.cc:1467] Processing CreateTablet for tablet c67d035aa3bf4023926381ffb6235701 (DEFAULT_TABLE table=test-table [id=3108b6cb19844441a2db627931cef440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:03.894546 25017 tablet_service.cc:1467] Processing CreateTablet for tablet c67d035aa3bf4023926381ffb6235701 (DEFAULT_TABLE table=test-table [id=3108b6cb19844441a2db627931cef440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:03.894846 24824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67d035aa3bf4023926381ffb6235701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:03.894846 25017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67d035aa3bf4023926381ffb6235701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:03.897042 25466 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851: Bootstrap starting.
I20260809 15:41:03.897084 25468 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Bootstrap starting.
I20260809 15:41:03.898025 25466 tablet_bootstrap.cc:654] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:03.898353 25459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.889136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45993 (local address 127.0.0.1:37300)
0809 15:41:03.889784 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.889795 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:03.889914 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:03.890171 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:03.890174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:03.890190 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:03.890300 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.890309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.892367 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.892370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.894560 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.894574 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.897930 (+ 3356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.897934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.898026 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.898048 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:41:03.898122 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 15:41:03.898193 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":21,"thread_start_us":88,"threads_started":1}
I20260809 15:41:03.898376 25461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.889251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37300 (local address 127.14.15.131:45993)
0809 15:41:03.889541 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.889546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.889872 (+ 326us) server_negotiation.cc:407] Connection header received
0809 15:41:03.890000 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.890003 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.890066 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.890150 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:03.890568 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.891139 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.897106 (+ 5967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.897814 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.897930 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.897994 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.898139 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.898235 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":104,"threads_started":1}
I20260809 15:41:03.898921 25468 tablet_bootstrap.cc:654] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:03.898999 25194 tablet_service.cc:1467] Processing CreateTablet for tablet c67d035aa3bf4023926381ffb6235701 (DEFAULT_TABLE table=test-table [id=3108b6cb19844441a2db627931cef440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:03.899278 25194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67d035aa3bf4023926381ffb6235701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:03.899418 25466 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851: No bootstrap required, opened a new log
I20260809 15:41:03.899547 25466 ts_tablet_manager.cc:1397] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:03.899979 25466 raft_consensus.cc:348] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.900089 25468 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: No bootstrap required, opened a new log
I20260809 15:41:03.900161 25466 raft_consensus.cc:374] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:03.900179 25468 ts_tablet_manager.cc:1397] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:03.900223 25466 raft_consensus.cc:729] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad54bf5e19a444fb3fa48cebf2b4851, State: Initialized, Role: FOLLOWER
I20260809 15:41:03.900400 25466 consensus_queue.cc:260] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.900563 25468 raft_consensus.cc:348] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.900749 25468 raft_consensus.cc:374] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:03.900837 25468 raft_consensus.cc:729] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286f0962394b4fa89f88f74f812948f8, State: Initialized, Role: FOLLOWER
I20260809 15:41:03.900857 25466 ts_tablet_manager.cc:1428] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:03.901055 25468 consensus_queue.cc:260] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.901505 25468 ts_tablet_manager.cc:1428] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:03.901912 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.901254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:44369)
0809 15:41:03.901777 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.901834 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436}
I20260809 15:41:03.901976 25474 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Bootstrap starting.
I20260809 15:41:03.902987 25474 tablet_bootstrap.cc:654] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:03.903316 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.902260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:49635)
0809 15:41:03.903205 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.903261 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":869}
I20260809 15:41:03.904311 25474 tablet_bootstrap.cc:492] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: No bootstrap required, opened a new log
I20260809 15:41:03.904435 25474 ts_tablet_manager.cc:1397] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:03.904790 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.904559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:47537)
0809 15:41:03.904672 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.904726 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 15:41:03.904927 25474 raft_consensus.cc:348] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.905102 25474 raft_consensus.cc:374] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:03.905158 25474 raft_consensus.cc:729] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15385e6d58494bb79f7b060b0ca2ef77, State: Initialized, Role: FOLLOWER
I20260809 15:41:03.905308 25474 consensus_queue.cc:260] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.905503 25117 heartbeater.cc:503] Master 127.14.15.189:41923 was elected leader, sending a full tablet report...
I20260809 15:41:03.906064 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.905786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:40313)
0809 15:41:03.905930 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.905980 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 15:41:03.906137 25474 ts_tablet_manager.cc:1428] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:03.906473 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.906072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:57371)
0809 15:41:03.906347 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.906404 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260809 15:41:03.907814 25316 heartbeater.cc:503] Master 127.14.15.189:41923 was elected leader, sending a full tablet report...
I20260809 15:41:03.907938 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.907444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:55637)
0809 15:41:03.907817 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.907869 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307}
I20260809 15:41:03.909555 24921 heartbeater.cc:503] Master 127.14.15.189:41923 was elected leader, sending a full tablet report...
I20260809 15:41:03.928354 25472 raft_consensus.cc:482] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:03.928519 25472 raft_consensus.cc:504] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.929685 25472 leader_election.cc:288] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209), 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:41:03.935045 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.930066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53117 (local address 127.14.15.129:40209)
0809 15:41:03.930203 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.930207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.930348 (+ 141us) server_negotiation.cc:407] Connection header received
0809 15:41:03.930516 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.930519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.930572 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.930656 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:03.931049 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.931833 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.933740 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.934373 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.934492 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.934549 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.934835 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.934907 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:41:03.935037 25461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.930005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:43277 (local address 127.14.15.131:45993)
0809 15:41:03.930139 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.930143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.930413 (+ 270us) server_negotiation.cc:407] Connection header received
0809 15:41:03.930530 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.930533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.930581 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.930656 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:03.931046 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.931835 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.933740 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.934366 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.934492 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.934559 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.934835 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.934907 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:41:03.935103 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.929863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45993 (local address 127.14.15.130:43277)
0809 15:41:03.930324 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.930337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:03.930418 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:03.930683 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:03.930686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:03.930716 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:03.930928 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.930937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.931967 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.931970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.933613 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.933624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.934510 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.934514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.934684 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.934731 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 15:41:03.934809 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:41:03.934943 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":481,"spinlock_wait_cycles":6272,"thread_start_us":151,"threads_started":1}
I20260809 15:41:03.935103 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.929863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:40209 (local address 127.14.15.130:53117)
0809 15:41:03.930267 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.930283 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:03.930409 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:03.930683 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:03.930686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:03.930718 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:03.930934 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.930939 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.931967 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.931970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.933612 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:03.933624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.934510 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.934514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:03.934681 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.934725 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 15:41:03.934817 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 15:41:03.934943 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":320,"spinlock_wait_cycles":6016}
I20260809 15:41:03.935998 24859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67d035aa3bf4023926381ffb6235701" candidate_uuid: "286f0962394b4fa89f88f74f812948f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" is_pre_election: true
I20260809 15:41:03.936084 25244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67d035aa3bf4023926381ffb6235701" candidate_uuid: "286f0962394b4fa89f88f74f812948f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15385e6d58494bb79f7b060b0ca2ef77" is_pre_election: true
I20260809 15:41:03.936239 25244 raft_consensus.cc:2454] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286f0962394b4fa89f88f74f812948f8 in term 0.
I20260809 15:41:03.936251 24859 raft_consensus.cc:2454] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286f0962394b4fa89f88f74f812948f8 in term 0.
I20260809 15:41:03.936662 24958 leader_election.cc:302] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15385e6d58494bb79f7b060b0ca2ef77, 286f0962394b4fa89f88f74f812948f8; no voters:
I20260809 15:41:03.936941 25472 raft_consensus.cc:2781] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:03.937011 25472 raft_consensus.cc:482] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:03.937049 25472 raft_consensus.cc:3037] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:03.938071 25472 raft_consensus.cc:504] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.938452 25472 leader_election.cc:288] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [CANDIDATE]: Term 1 election: Requested vote from peers bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209), 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993)
I20260809 15:41:03.938735 24859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67d035aa3bf4023926381ffb6235701" candidate_uuid: "286f0962394b4fa89f88f74f812948f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad54bf5e19a444fb3fa48cebf2b4851"
I20260809 15:41:03.938822 25244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67d035aa3bf4023926381ffb6235701" candidate_uuid: "286f0962394b4fa89f88f74f812948f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15385e6d58494bb79f7b060b0ca2ef77"
I20260809 15:41:03.938870 24859 raft_consensus.cc:3037] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:03.938951 25244 raft_consensus.cc:3037] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:03.940081 25244 raft_consensus.cc:2454] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286f0962394b4fa89f88f74f812948f8 in term 1.
I20260809 15:41:03.940081 24859 raft_consensus.cc:2454] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286f0962394b4fa89f88f74f812948f8 in term 1.
I20260809 15:41:03.940361 24958 leader_election.cc:302] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15385e6d58494bb79f7b060b0ca2ef77, 286f0962394b4fa89f88f74f812948f8; no voters:
I20260809 15:41:03.940603 25472 raft_consensus.cc:2781] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:03.940825 25472 raft_consensus.cc:686] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 1 LEADER]: Becoming Leader. State: Replica: 286f0962394b4fa89f88f74f812948f8, State: Running, Role: LEADER
I20260809 15:41:03.941082 25472 consensus_queue.cc:237] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } }
I20260809 15:41:03.941625 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.941362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:47695)
0809 15:41:03.941499 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.941560 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 15:41:03.943526 24384 catalog_manager.cc:5495] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 286f0962394b4fa89f88f74f812948f8 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "286f0962394b4fa89f88f74f812948f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286f0962394b4fa89f88f74f812948f8" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 } health_report { overall_health: UNKNOWN } } }
I20260809 15:41:03.960119 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.956663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.14.15.130:42491)
0809 15:41:03.956787 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:03.956791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:03.956806 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:41:03.956875 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:03.956877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:03.956930 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:03.957029 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:03.957228 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.957747 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.958665 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:03.958878 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:03.958959 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:03.959177 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:03.959709 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:03.959804 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:03.959945 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 15:41:03.960000 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:41:03.962940 25244 raft_consensus.cc:1261] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Refusing update from remote peer 286f0962394b4fa89f88f74f812948f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:03.963160 24859 raft_consensus.cc:1261] T c67d035aa3bf4023926381ffb6235701 P bad54bf5e19a444fb3fa48cebf2b4851 [term 1 FOLLOWER]: Refusing update from remote peer 286f0962394b4fa89f88f74f812948f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:03.963477 25481 consensus_queue.cc:1035] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15385e6d58494bb79f7b060b0ca2ef77" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:03.963744 25472 consensus_queue.cc:1035] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad54bf5e19a444fb3fa48cebf2b4851" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:03.965330 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.965053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:57435)
0809 15:41:03.965167 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.965246 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 15:41:03.965518 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.965229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:47169)
0809 15:41:03.965382 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.965449 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 15:41:03.967680 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.967410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:52407)
0809 15:41:03.967554 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.967606 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 15:41:03.970091 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.968057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.131:56229)
0809 15:41:03.969956 (+ 1899us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.970011 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1829}
I20260809 15:41:03.975497 24384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:03.975701 24384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:03.976337 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.975860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.130:55887)
0809 15:41:03.976202 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.976261 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251}
I20260809 15:41:03.977816 25492 mvcc.cc:205] Tried to move back new op lower bound from 7316644101986439168 to 7316644101905833984. Current Snapshot: MvccSnapshot[applied={T|T < 7316644101986439168}]
I20260809 15:41:03.977932 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:03.977245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39441 (local address 127.14.15.129:41399)
0809 15:41:03.977799 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:03.977855 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:39441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474}
I20260809 15:41:03.980605 24384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dff0ad13c1f54ed882b865c2f314262b: Sending DeleteTablet for 3 replicas of tablet c67d035aa3bf4023926381ffb6235701
I20260809 15:41:03.981423 24824 tablet_service.cc:1514] Processing DeleteTablet for tablet c67d035aa3bf4023926381ffb6235701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:03 UTC) from {username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:38704
I20260809 15:41:03.981577 25194 tablet_service.cc:1514] Processing DeleteTablet for tablet c67d035aa3bf4023926381ffb6235701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:03 UTC) from {username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:37300
I20260809 15:41:03.981746 25017 tablet_service.cc:1514] Processing DeleteTablet for tablet c67d035aa3bf4023926381ffb6235701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:03 UTC) from {username='oryx', principal='oryx/127.14.15.189@KRBTEST.COM'} at 127.0.0.1:38636
I20260809 15:41:03.982111 25500 tablet_replica.cc:330] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: stopping tablet replica
I20260809 15:41:03.982291 25497 tablet_replica.cc:330] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: stopping tablet replica
I20260809 15:41:03.982298 25500 raft_consensus.cc:2229] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:03.982503 25497 raft_consensus.cc:2229] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:03.982594 25500 raft_consensus.cc:2258] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:03.982694 25497 raft_consensus.cc:2258] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:03.982726 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 24609
I20260809 15:41:03.985996 25500 ts_tablet_manager.cc:1905] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:03.988880 25500 ts_tablet_manager.cc:1918] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:03.989038 25500 log.cc:1196] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/c67d035aa3bf4023926381ffb6235701
I20260809 15:41:03.989403 25500 ts_tablet_manager.cc:1939] T c67d035aa3bf4023926381ffb6235701 P 286f0962394b4fa89f88f74f812948f8: Deleting consensus metadata
I20260809 15:41:03.990267 24366 catalog_manager.cc:4841] TS 286f0962394b4fa89f88f74f812948f8 (127.14.15.130:42491): tablet c67d035aa3bf4023926381ffb6235701 (table test-table [id=3108b6cb19844441a2db627931cef440]) successfully deleted
I20260809 15:41:03.994436 25497 ts_tablet_manager.cc:1905] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:03.997117 25497 ts_tablet_manager.cc:1918] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:03.997216 25497 log.cc:1196] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/c67d035aa3bf4023926381ffb6235701
I20260809 15:41:03.997524 25497 ts_tablet_manager.cc:1939] T c67d035aa3bf4023926381ffb6235701 P 15385e6d58494bb79f7b060b0ca2ef77: Deleting consensus metadata
I20260809 15:41:03.998317 24362 catalog_manager.cc:4841] TS 15385e6d58494bb79f7b060b0ca2ef77 (127.14.15.131:45993): tablet c67d035aa3bf4023926381ffb6235701 (table test-table [id=3108b6cb19844441a2db627931cef440]) successfully deleted
I20260809 15:41:04.006699 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 24928
I20260809 15:41:04.006947 25459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:04.006667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:40209 (local address 127.0.0.1:38714)
0809 15:41:04.006788 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:04.006849 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 15:41:04.013366 24366 catalog_manager.cc:4584] TS bad54bf5e19a444fb3fa48cebf2b4851 (127.14.15.129:40209): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c67d035aa3bf4023926381ffb6235701: Network error: Client connection negotiation failed: client connection to 127.14.15.129:40209: connect: Connection refused (error 111)
I20260809 15:41:04.020295 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 25126
I20260809 15:41:04.035696 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 24195
I20260809 15:41:04.046202 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 24334
2026-08-09T15:41:04Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7556 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:41:04 dist-test-slave-jztv krb5kdc[25505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:41:04 dist-test-slave-jztv krb5kdc[25505](info): set up 2 sockets
Aug 09 15:41:04 dist-test-slave-jztv krb5kdc[25505](info): commencing operation
krb5kdc: starting...
W20260809 15:41:05.295480 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:41:05 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:41:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:05Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab.
Entry for principal oryx/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab.
I20260809 15:41:05.429768 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34203
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab
--principal=oryx/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:05.556497 25524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:05.556861 25524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:05.556924 25524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:05.561098 25524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:05.561178 25524 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:41:05.561195 25524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:05.561213 25524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:05.561230 25524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:05.561245 25524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:05.566948 25524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34203
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.190.keytab
--principal=oryx/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:05.568087 25524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:05.569098 25524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:05.578199 25529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:05.578192 25533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:05.578299 25524 server_base.cc:1034] running on GCE node
W20260809 15:41:05.578192 25538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:05.579025 25524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:05.580106 25524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:05.581265 25524 hybrid_clock.cc:648] HybridClock initialized: now 1786290065581245 us; error 32 us; skew 500 ppm
Aug 09 15:41:05 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:05.587045 25524 init.cc:377] Logged in from keytab as oryx/127.14.15.190@KRBTEST.COM (short username oryx)
I20260809 15:41:05.588057 25524 webserver.cc:460] Webserver started at http://127.14.15.190:33691/ using document root <none> and password file <none>
I20260809 15:41:05.588641 25524 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:05.588706 25524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:05.588953 25524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:05.591205 25524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "52b6f58f6045468290b95dd8cb6eee74"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "7bf36fcc5b88218083b9b5894066603e"
server_key_iv: "516fbaa613ebe4a02a3c98ce15d9c0c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.591812 25524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "52b6f58f6045468290b95dd8cb6eee74"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "7bf36fcc5b88218083b9b5894066603e"
server_key_iv: "516fbaa613ebe4a02a3c98ce15d9c0c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.596549 25524 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 15:41:05.599515 25549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:05.600989 25524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:05.601173 25524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "52b6f58f6045468290b95dd8cb6eee74"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "7bf36fcc5b88218083b9b5894066603e"
server_key_iv: "516fbaa613ebe4a02a3c98ce15d9c0c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.601313 25524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:05.628814 25524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:05.634331 25524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:05.634563 25524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:05.647455 25524 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:34203
I20260809 15:41:05.647467 25650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:34203 every 8 connection(s)
I20260809 15:41:05.648787 25524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:05.652398 25651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:05.658658 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 25524
I20260809 15:41:05.658821 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:41:05.659170 14398 external_mini_cluster.cc:1428] Setting key 51d945e671a20baaa9939fa36a4c4a14
I20260809 15:41:05.659293 25651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Bootstrap starting.
I20260809 15:41:05.662565 25651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:05.663399 25651 log.cc:824] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:05.665689 25651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: No bootstrap required, opened a new log
I20260809 15:41:05.670245 25651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } }
I20260809 15:41:05.670579 25651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:05.670656 25651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b6f58f6045468290b95dd8cb6eee74, State: Initialized, Role: FOLLOWER
I20260809 15:41:05.671276 25651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } }
I20260809 15:41:05.671468 25651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:05.671546 25651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:05.671654 25651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 15:41:05 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:05.672977 25651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } }
I20260809 15:41:05.673354 25651 leader_election.cc:302] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b6f58f6045468290b95dd8cb6eee74; no voters:
I20260809 15:41:05.673776 25651 leader_election.cc:288] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:41:05.673903 25659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:05.674150 25659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [term 1 LEADER]: Becoming Leader. State: Replica: 52b6f58f6045468290b95dd8cb6eee74, State: Running, Role: LEADER
I20260809 15:41:05.674525 25659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } }
I20260809 15:41:05.675191 25651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:05.676702 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b6f58f6045468290b95dd8cb6eee74. Latest consensus state: current_term: 1 leader_uuid: "52b6f58f6045468290b95dd8cb6eee74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } } }
I20260809 15:41:05.676860 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:05.677136 25660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52b6f58f6045468290b95dd8cb6eee74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b6f58f6045468290b95dd8cb6eee74" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34203 } } }
I20260809 15:41:05.677237 25660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74 [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:05.677265 25671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:05.680907 25671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:05.681879 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:05.662062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43940 (local address 127.14.15.190:34203)
0809 15:41:05.662951 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:05.662970 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:05.663019 (+ 49us) server_negotiation.cc:407] Connection header received
0809 15:41:05.663761 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:05.663780 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:05.664109 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:05.664398 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:05.665371 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.667200 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.668498 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.669284 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.669514 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:05.672740 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:05.672748 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:05.672769 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:05.672812 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:05.677923 (+ 5111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.678541 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.678547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.678553 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.678733 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.679082 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.679086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.679088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.679632 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:05.679807 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:05.680613 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 15:41:05.680923 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":504,"threads_started":1}
I20260809 15:41:05.688555 25671 catalog_manager.cc:1347] Generated new cluster ID: 7e5dff9a11014e46ab49a900a8519819
I20260809 15:41:05.688722 25671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:05.728994 25671 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:41:05.729949 25671 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:05.738263 25671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Generated new TSK 0
I20260809 15:41:05.738968 25671 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
I20260809 15:41:05.777887 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34203
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:05.897318 25682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:05.897621 25682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:05.897668 25682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:05.901844 25682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:05.901921 25682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:05.901960 25682 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:41:05.902031 25682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:05.907881 25682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:05.909119 25682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:05.910277 25682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:05.920569 25687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:05.920569 25691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:05.920867 25682 server_base.cc:1034] running on GCE node
W20260809 15:41:05.920867 25688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:05.921531 25682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:05.922286 25682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:05.923534 25682 hybrid_clock.cc:648] HybridClock initialized: now 1786290065923498 us; error 45 us; skew 500 ppm
Aug 09 15:41:05 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:05.926601 25682 init.cc:377] Logged in from keytab as oryx/127.14.15.129@KRBTEST.COM (short username oryx)
I20260809 15:41:05.927567 25682 webserver.cc:460] Webserver started at http://127.14.15.129:34515/ using document root <none> and password file <none>
I20260809 15:41:05.928169 25682 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:05.928267 25682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:05.928548 25682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:05.930778 25682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "057bbd9b7a094f2096e9c19af5f102d4"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "d2160162ddc9a98415d59665855159c9"
server_key_iv: "cdf6df3fe6642ecb53ac9d2684a99e4f"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.931398 25682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "057bbd9b7a094f2096e9c19af5f102d4"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "d2160162ddc9a98415d59665855159c9"
server_key_iv: "cdf6df3fe6642ecb53ac9d2684a99e4f"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.935334 25682 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:41:05.937840 25701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:05.939191 25682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:05.939332 25682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "057bbd9b7a094f2096e9c19af5f102d4"
format_stamp: "Formatted at 2026-08-09 15:41:05 on dist-test-slave-jztv"
server_key: "d2160162ddc9a98415d59665855159c9"
server_key_iv: "cdf6df3fe6642ecb53ac9d2684a99e4f"
server_key_version: "encryptionkey@0"
I20260809 15:41:05.939493 25682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:05.962355 25682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:05.965869 25682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:05.966045 25682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:05.967674 25682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:05.967731 25682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:05.967775 25682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:05.967826 25682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:41:05 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:05.980755 25682 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:37269
I20260809 15:41:05.981025 25868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:37269 every 8 connection(s)
I20260809 15:41:05.981956 25682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:05.983721 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:05.968863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.129:50415)
0809 15:41:05.969345 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:05.969396 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:05.970357 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:05.971272 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:05.971281 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:05.971636 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:05.972155 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:05.972178 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.973030 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.973034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:05.974264 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:05.974282 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.975046 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.975051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:05.975243 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:05.976145 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:05.976165 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:05.978332 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:05.980478 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:05.980485 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:05.980501 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:05.980891 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:05.981235 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:05.981238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:05.981239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:05.981437 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:05.981938 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:05.981943 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:05.982296 (+ 353us) client_negotiation.cc:769] Sending connection context
0809 15:41:05.982512 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 15:41:05.982888 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":134,"threads_started":1}
I20260809 15:41:05.984390 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:05.968484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:50415 (local address 127.14.15.190:34203)
0809 15:41:05.968668 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:05.968676 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:05.969515 (+ 839us) server_negotiation.cc:407] Connection header received
0809 15:41:05.970610 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:05.970616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:05.970685 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:05.970778 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:05.972313 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.972883 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.974416 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.974862 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.974987 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:05.978533 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:05.978537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:05.978539 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:05.978573 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:05.980323 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.981025 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.981029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.981031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.981127 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.981563 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.981570 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.981575 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.981816 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:05.981929 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:05.984157 (+ 2228us) server_negotiation.cc:299] Negotiation successful
0809 15:41:05.984277 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:41:05.985531 25869 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34203
I20260809 15:41:05.985730 25869 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:05.985917 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 25682
I20260809 15:41:05.986058 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:41:05.986378 25869 heartbeater.cc:511] Master 127.14.15.190:34203 requested a full tablet report, sending...
I20260809 15:41:05.986444 14398 external_mini_cluster.cc:1428] Setting key f83c2b48f7e383ae3fffbc4faf7b73e3
I20260809 15:41:05.988610 25575 ts_manager.cc:194] Registered new tserver with Master: 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269)
I20260809 15:41:05.990043 25575 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:50415
I20260809 15:41:05.996523 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:05.988081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:42115 (local address 127.14.15.190:34203)
0809 15:41:05.988196 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:05.988200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:05.988481 (+ 281us) server_negotiation.cc:407] Connection header received
0809 15:41:05.988689 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:05.988695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:05.988746 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:05.988796 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:05.989427 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.990300 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.991365 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.991593 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.991702 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:05.993092 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:05.993094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:05.993097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:05.993119 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:05.994755 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.995298 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.995301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.995302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.995394 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:05.995723 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:05.995725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:05.995726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:05.995898 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:05.995975 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:05.996295 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 15:41:05.996396 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":35}
I20260809 15:41:05.996655 25879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:05.988111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.129:42115)
0809 15:41:05.988395 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:05.988410 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:05.988575 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:05.988939 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:05.988941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:05.989171 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:05.989291 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:05.989299 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.990476 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.990479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:05.991232 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:05.991242 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:05.991707 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:05.991711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:05.991804 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:05.992414 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:05.992445 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:05.992946 (+ 501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:05.994872 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:05.994878 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:05.994881 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:05.995181 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:05.995500 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:05.995505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:05.995507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:05.995622 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:05.995995 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:05.996000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:05.996123 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 15:41:05.996244 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 15:41:05.996400 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for oryx/127.14.15.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
I20260809 15:41:06.017866 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34203
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:06.133366 25883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:06.133685 25883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:06.133772 25883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:06.137881 25883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:06.137974 25883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:06.138041 25883 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:41:06.138125 25883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:06.143658 25883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:06.144735 25883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:06.145751 25883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:06.155485 25894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:06.155476 25892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:06.155584 25883 server_base.cc:1034] running on GCE node
W20260809 15:41:06.155476 25896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:06.156126 25883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:06.156836 25883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:06.158049 25883 hybrid_clock.cc:648] HybridClock initialized: now 1786290066158026 us; error 33 us; skew 500 ppm
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:06.161093 25883 init.cc:377] Logged in from keytab as oryx/127.14.15.130@KRBTEST.COM (short username oryx)
I20260809 15:41:06.162055 25883 webserver.cc:460] Webserver started at http://127.14.15.130:45279/ using document root <none> and password file <none>
I20260809 15:41:06.162696 25883 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:06.162796 25883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:06.163048 25883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:06.165172 25883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "4d1c2dbf91981681087ffab9d13ced27"
server_key_iv: "3dda35802b04f5b74734f6b25ce6f0b0"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.165789 25883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "4d1c2dbf91981681087ffab9d13ced27"
server_key_iv: "3dda35802b04f5b74734f6b25ce6f0b0"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.170171 25883 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 15:41:06.172809 25907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:06.174111 25883 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:41:06.174333 25883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "4d1c2dbf91981681087ffab9d13ced27"
server_key_iv: "3dda35802b04f5b74734f6b25ce6f0b0"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.174479 25883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:06.189399 25883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:06.192960 25883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:06.193193 25883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:06.194886 25883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:06.194962 25883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:06.195036 25883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:06.195087 25883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:06.207005 25883 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:38237
I20260809 15:41:06.207929 26073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:38237 every 8 connection(s)
I20260809 15:41:06.208207 25883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:06.210073 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.195832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51597 (local address 127.14.15.190:34203)
0809 15:41:06.196029 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.196036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.196999 (+ 963us) server_negotiation.cc:407] Connection header received
0809 15:41:06.198379 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.198382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.198473 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.198602 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.200044 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.200631 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.202030 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.202364 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.202490 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.205621 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.205627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.205631 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.205668 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.207659 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.208334 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.208339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.208341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.208449 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.208898 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.208902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.208904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.209168 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.209272 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.209823 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.209938 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:41:06.210901 25918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.196258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.130:51597)
0809 15:41:06.196794 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.196857 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.198061 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.198935 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.198942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.199319 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:06.199866 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.199882 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.200780 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.200784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.201875 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.201887 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.202564 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.202569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.202757 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.203609 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:06.203636 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:06.205390 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:06.207817 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.207824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.207842 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.208211 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.208579 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.208583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.208585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.208740 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.209303 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:06.209310 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:06.209587 (+ 277us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.209754 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.210010 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":127,"threads_started":1}
I20260809 15:41:06.212169 26074 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34203
I20260809 15:41:06.212332 26074 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:06.212838 26074 heartbeater.cc:511] Master 127.14.15.190:34203 requested a full tablet report, sending...
I20260809 15:41:06.213898 25574 ts_manager.cc:194] Registered new tserver with Master: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:06.214570 25574 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:51597
I20260809 15:41:06.216187 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 25883
I20260809 15:41:06.216332 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:41:06.216637 14398 external_mini_cluster.cc:1428] Setting key 67360795bbb23cab2255d093fb16c70d
I20260809 15:41:06.222970 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.214834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:42283 (local address 127.14.15.190:34203)
0809 15:41:06.214963 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.214967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.215212 (+ 245us) server_negotiation.cc:407] Connection header received
0809 15:41:06.215383 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.215386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.215432 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.215534 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.216076 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.216662 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.217663 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.218031 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.218146 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.219345 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.219353 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.219359 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.219409 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.221159 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.221660 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.221663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.221664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.221742 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.222045 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.222048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.222049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.222339 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.222428 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.222755 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.222855 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:41:06.223151 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.214739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.130:42283)
0809 15:41:06.215120 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.215132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.215270 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.215552 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.215555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.215782 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:06.215915 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.215925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.216792 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.216796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.217549 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.217559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.218153 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.218156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.218277 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.218853 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:06.218866 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:06.219192 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:06.221267 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.221272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.221275 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.221560 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.221834 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.221839 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.221842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.221949 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.222443 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:06.222449 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:06.222575 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.222698 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.222866 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":130,"threads_started":1}
WARNING: no policy specified for oryx/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
I20260809 15:41:06.246079 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34203
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:06.363525 26083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:06.363780 26083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:06.363826 26083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:06.367774 26083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:06.367821 26083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:06.367858 26083 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:41:06.367888 26083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:06.373057 26083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.15.190:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:06.374018 26083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:06.375041 26083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:41:06.385288 26083 server_base.cc:1034] running on GCE node
W20260809 15:41:06.385192 26095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:06.385246 26091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:06.385188 26092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:06.385954 26083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:06.386751 26083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:06.387950 26083 hybrid_clock.cc:648] HybridClock initialized: now 1786290066387933 us; error 33 us; skew 500 ppm
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:06.390806 26083 init.cc:377] Logged in from keytab as oryx/127.14.15.131@KRBTEST.COM (short username oryx)
I20260809 15:41:06.391703 26083 webserver.cc:460] Webserver started at http://127.14.15.131:40231/ using document root <none> and password file <none>
I20260809 15:41:06.392288 26083 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:06.392386 26083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:06.392635 26083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:06.394802 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "752e194fec1d43a6953416d00390ccec"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "ec6df2bbac5154bf8d416c64fe20fab8"
server_key_iv: "79ae599b714973686ff590b1fad4c1fb"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.395396 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "752e194fec1d43a6953416d00390ccec"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "ec6df2bbac5154bf8d416c64fe20fab8"
server_key_iv: "79ae599b714973686ff590b1fad4c1fb"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.399219 26083 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:41:06.401958 26106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:06.403294 26083 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:06.403445 26083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "752e194fec1d43a6953416d00390ccec"
format_stamp: "Formatted at 2026-08-09 15:41:06 on dist-test-slave-jztv"
server_key: "ec6df2bbac5154bf8d416c64fe20fab8"
server_key_iv: "79ae599b714973686ff590b1fad4c1fb"
server_key_version: "encryptionkey@0"
I20260809 15:41:06.403576 26083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:06.427698 26083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:06.430912 26083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:06.431149 26083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:06.432686 26083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:06.432766 26083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:06.432845 26083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:06.432890 26083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:06.444900 26083 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:43261
I20260809 15:41:06.444964 26272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:43261 every 8 connection(s)
I20260809 15:41:06.445972 26083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:06.447842 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.434064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.131:58181)
0809 15:41:06.434631 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.434695 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.435908 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.436601 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.436611 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.437120 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:06.437931 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.437959 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.438884 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.438887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.439777 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.439787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.440339 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.440343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.440569 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.441232 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:06.441249 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:06.442820 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:06.445023 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.445029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.445043 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.445324 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.445654 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.445656 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.445658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.445791 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.446281 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:06.446287 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:06.446627 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.446827 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.447117 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":166,"threads_started":1}
I20260809 15:41:06.448447 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.433654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:58181 (local address 127.14.15.190:34203)
0809 15:41:06.433817 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.433822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.434822 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 15:41:06.436187 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.436191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.436258 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.436353 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.438098 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.438749 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.439913 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.440181 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.440294 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.443017 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.443023 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.443030 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.443068 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.444886 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.445436 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.445441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.445443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.445549 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.445895 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.445898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.445900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.446149 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.446278 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.448235 (+ 1957us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.448340 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:41:06.449316 26275 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34203
I20260809 15:41:06.449550 26275 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:06.450048 26275 heartbeater.cc:511] Master 127.14.15.190:34203 requested a full tablet report, sending...
I20260809 15:41:06.451176 25575 ts_manager.cc:194] Registered new tserver with Master: 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261)
I20260809 15:41:06.451782 25575 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:58181
I20260809 15:41:06.453670 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 26083
I20260809 15:41:06.453835 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:41:06.454144 14398 external_mini_cluster.cc:1428] Setting key c647d891867b7e95a76b464ed40ad092
I20260809 15:41:06.456403 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:41:06.459777 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.451851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:56607 (local address 127.14.15.190:34203)
0809 15:41:06.451964 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.451967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.452259 (+ 292us) server_negotiation.cc:407] Connection header received
0809 15:41:06.452363 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.452367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.452416 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.452488 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.452985 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.453559 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.454572 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.454883 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.454994 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.456295 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.456298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.456300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.456339 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.457954 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.458476 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.458482 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.458487 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.458584 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.458854 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.458860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.458864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.459128 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.459242 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.459570 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.459666 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:41:06.459944 26282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.451768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.14.15.131:56607)
0809 15:41:06.452165 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.452181 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.452278 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.452533 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.452536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.452747 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:06.452871 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.452878 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.453707 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.453711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.454429 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.454439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.455017 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.455023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.455122 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.455708 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:06.455722 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:06.456156 (+ 434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:06.458087 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.458090 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.458091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.458380 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.458680 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.458682 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.458684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.458763 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.459250 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:06.459253 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:06.459355 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.459522 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.459695 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":128,"threads_started":1}
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:41:06.484035 25655 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:06.478007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43954 (local address 127.14.15.190:34203)
0809 15:41:06.478134 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.478138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.478151 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:41:06.478193 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.478195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.478287 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.478366 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.479063 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.479638 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.480449 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.480660 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.480738 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.483903 (+ 3165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43954: BlockingRecv error: recv got EOF from 127.0.0.1:43954 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290066, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:06.493701 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.485566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43956 (local address 127.14.15.190:34203)
0809 15:41:06.485713 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.485717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.485867 (+ 150us) server_negotiation.cc:407] Connection header received
0809 15:41:06.486032 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.486040 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.486078 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.486158 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.486893 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.487392 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.488194 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.488409 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.488514 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.490838 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.490842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.490845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.490870 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.492079 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.492491 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.492495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.492496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.492580 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.492852 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.492857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.492858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.493043 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.493184 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.493417 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.493533 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:41:06.496519 25575 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:06.499750 25575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:06.514416 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.508732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.14.15.129:37269)
0809 15:41:06.510013 (+ 1281us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.510019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.510050 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:41:06.510124 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.510129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.510330 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.510481 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.510712 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511569 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.513096 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.513688 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.513810 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.513982 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.514146 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.514285 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1173,"thread_start_us":89,"threads_started":1}
I20260809 15:41:06.514416 26308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.508343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37269 (local address 127.0.0.1:46234)
0809 15:41:06.509166 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.509180 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.509277 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.510463 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.510466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.510486 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.510582 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.510592 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511750 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.511754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.512978 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.512986 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.513823 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.513826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.513948 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.513990 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.514105 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.514256 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":58,"thread_start_us":98,"threads_started":1}
I20260809 15:41:06.514734 26310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.508115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43261 (local address 127.0.0.1:37642)
0809 15:41:06.508729 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.508785 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.508914 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.509726 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.509731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.509753 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.509854 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.509859 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511264 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.511267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.512781 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.512794 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.514093 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.514097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.514329 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.514414 (+ 85us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.514500 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.514593 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":151,"spinlock_wait_cycles":20224,"thread_start_us":101,"threads_started":1}
I20260809 15:41:06.514835 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.508093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49386 (local address 127.14.15.130:38237)
0809 15:41:06.509516 (+ 1423us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.509527 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.509549 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:41:06.509626 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.509633 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.509809 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.509982 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.510572 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511526 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.512955 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.513757 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.513865 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.514030 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.514592 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.514683 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1326,"thread_start_us":109,"threads_started":1}
I20260809 15:41:06.515175 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.507923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38237 (local address 127.0.0.1:49386)
0809 15:41:06.508728 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.508784 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.508914 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.510303 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.510306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.510327 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.510425 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.510431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511638 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.511642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.512805 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.512820 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.514093 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.514097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.514333 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.514416 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.514491 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.515026 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":571,"spinlock_wait_cycles":3200,"thread_start_us":68,"threads_started":1}
I20260809 15:41:06.515774 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.508673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.14.15.131:43261)
0809 15:41:06.509210 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.509224 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.509251 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:41:06.509331 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.509338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.509567 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.509728 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.509978 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.511137 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.512922 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.513758 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.513864 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.514023 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.515493 (+ 1470us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.515624 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":105,"threads_started":1}
I20260809 15:41:06.517623 25773 tablet_service.cc:1467] Processing CreateTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd (DEFAULT_TABLE table=test-table [id=7294f3777a544288a7787f19e6b26084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.517870 25976 tablet_service.cc:1467] Processing CreateTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd (DEFAULT_TABLE table=test-table [id=7294f3777a544288a7787f19e6b26084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.518749 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ed5526ec080431caa428cde2aa5f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.518865 25976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ed5526ec080431caa428cde2aa5f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.520717 26174 tablet_service.cc:1467] Processing CreateTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd (DEFAULT_TABLE table=test-table [id=7294f3777a544288a7787f19e6b26084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.521720 26174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ed5526ec080431caa428cde2aa5f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.525826 26315 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Bootstrap starting.
I20260809 15:41:06.527102 26316 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Bootstrap starting.
I20260809 15:41:06.528112 26315 tablet_bootstrap.cc:654] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.528901 26315 log.cc:824] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:06.529273 26316 tablet_bootstrap.cc:654] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.530630 26316 log.cc:824] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:06.530778 26318 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Bootstrap starting.
I20260809 15:41:06.531414 26315 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: No bootstrap required, opened a new log
I20260809 15:41:06.531641 26315 ts_tablet_manager.cc:1397] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:41:06.532612 26316 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: No bootstrap required, opened a new log
I20260809 15:41:06.532815 26316 ts_tablet_manager.cc:1397] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:41:06.532840 26318 tablet_bootstrap.cc:654] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.533627 26318 log.cc:824] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:06.535048 26315 raft_consensus.cc:348] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.535300 26315 raft_consensus.cc:374] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.535365 26315 raft_consensus.cc:729] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.535658 26318 tablet_bootstrap.cc:492] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: No bootstrap required, opened a new log
I20260809 15:41:06.535844 26318 ts_tablet_manager.cc:1397] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:41:06.535868 26315 consensus_queue.cc:260] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.536736 26316 raft_consensus.cc:348] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.536939 26315 ts_tablet_manager.cc:1428] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260809 15:41:06.537002 26316 raft_consensus.cc:374] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.537055 26316 raft_consensus.cc:729] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057bbd9b7a094f2096e9c19af5f102d4, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.537312 26074 heartbeater.cc:503] Master 127.14.15.190:34203 was elected leader, sending a full tablet report...
I20260809 15:41:06.537452 26316 consensus_queue.cc:260] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.538072 25869 heartbeater.cc:503] Master 127.14.15.190:34203 was elected leader, sending a full tablet report...
I20260809 15:41:06.538395 26316 ts_tablet_manager.cc:1428] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 15:41:06.541422 26318 raft_consensus.cc:348] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.541714 26318 raft_consensus.cc:374] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.541781 26318 raft_consensus.cc:729] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.542299 26318 consensus_queue.cc:260] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.542979 26275 heartbeater.cc:503] Master 127.14.15.190:34203 was elected leader, sending a full tablet report...
I20260809 15:41:06.543298 26318 ts_tablet_manager.cc:1428] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 15:41:06.682053 26322 raft_consensus.cc:482] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:06.682361 26322 raft_consensus.cc:504] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.683629 26322 leader_election.cc:288] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261), 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269)
I20260809 15:41:06.688352 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.684002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53725 (local address 127.14.15.131:43261)
0809 15:41:06.684134 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.684137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.684154 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:41:06.684321 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.684324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.684378 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.684471 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.684816 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.685634 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.687074 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.687730 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.687865 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.687921 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.688110 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.688192 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:41:06.688417 25918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.683922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43261 (local address 127.14.15.130:53725)
0809 15:41:06.684044 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.684060 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.684195 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.684501 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.684505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.684524 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.684649 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.684675 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.685755 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.685759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.686916 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.686928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.687881 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.687885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.687971 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.688002 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.688071 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.688132 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 15:41:06.689100 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ed5526ec080431caa428cde2aa5f4fd" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec" is_pre_election: true
I20260809 15:41:06.689465 26207 raft_consensus.cc:2454] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:06.689515 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.683931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37269 (local address 127.14.15.130:45605)
0809 15:41:06.684591 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.684603 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.684692 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.684924 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.684927 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.684945 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.685073 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.685080 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.686247 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.686251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.688141 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.688151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.689115 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.689119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.689225 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.689242 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.689333 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.689409 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":355,"thread_start_us":116,"threads_started":1}
I20260809 15:41:06.689612 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.684006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:45605 (local address 127.14.15.129:37269)
0809 15:41:06.684133 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.684137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.684697 (+ 560us) server_negotiation.cc:407] Connection header received
0809 15:41:06.684766 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.684769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.684827 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.684885 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.685243 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.685873 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.688392 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.688963 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.689108 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.689159 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.689389 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.689479 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:41:06.690091 25911 leader_election.cc:302] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752e194fec1d43a6953416d00390ccec, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:06.690169 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ed5526ec080431caa428cde2aa5f4fd" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:06.690445 26322 raft_consensus.cc:2781] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:06.690497 25810 raft_consensus.cc:2454] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:06.690546 26322 raft_consensus.cc:482] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:06.690601 26322 raft_consensus.cc:3037] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.691712 26322 raft_consensus.cc:504] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
I20260809 15:41:06.692063 26322 leader_election.cc:288] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261), 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269)
I20260809 15:41:06.692432 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ed5526ec080431caa428cde2aa5f4fd" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:06.692443 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ed5526ec080431caa428cde2aa5f4fd" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec"
I20260809 15:41:06.692536 25810 raft_consensus.cc:3037] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.692598 26207 raft_consensus.cc:3037] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.693627 25810 raft_consensus.cc:2454] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 1.
I20260809 15:41:06.693943 25908 leader_election.cc:302] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:06.694116 26207 raft_consensus.cc:2454] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 1.
I20260809 15:41:06.694171 26322 raft_consensus.cc:2781] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:06.694425 26322 raft_consensus.cc:686] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 LEADER]: Becoming Leader. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Running, Role: LEADER
I20260809 15:41:06.694792 26322 consensus_queue.cc:237] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } }
W20260809 15:41:06.697427 26276 tablet.cc:2369] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:41:06.698084 25575 catalog_manager.cc:5495] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } health_report { overall_health: UNKNOWN } } }
W20260809 15:41:06.709630 26075 tablet.cc:2369] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:41:06.733803 25870 tablet.cc:2369] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:41:06.749439 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.745691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49388 (local address 127.14.15.130:38237)
0809 15:41:06.745843 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.745848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.745864 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:41:06.746066 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.746068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.746125 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.746268 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:06.746534 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.747052 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.747913 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.748149 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.748261 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.748546 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:06.749008 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:06.749125 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.749187 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.749281 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:41:06.755548 25810 raft_consensus.cc:1261] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:06.755559 26207 raft_consensus.cc:1261] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:06.756306 26322 consensus_queue.cc:1035] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:06.756548 26330 consensus_queue.cc:1035] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:06.774314 25570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:06.774487 25570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:06.777289 25570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Sending DeleteTablet for 3 replicas of tablet 2ed5526ec080431caa428cde2aa5f4fd
I20260809 15:41:06.778118 25976 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:06 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49386
I20260809 15:41:06.778132 26174 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:06 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37642
I20260809 15:41:06.778306 25773 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ed5526ec080431caa428cde2aa5f4fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:06 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46234
I20260809 15:41:06.778868 26349 tablet_replica.cc:330] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: stopping tablet replica
I20260809 15:41:06.778903 26345 tablet_replica.cc:330] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: stopping tablet replica
I20260809 15:41:06.779315 26349 raft_consensus.cc:2229] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:06.779320 26345 raft_consensus.cc:2229] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:06.779608 25570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 15:41:06.779779 26349 raft_consensus.cc:2258] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:41:06.780084 25570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:06.780174 26346 tablet_replica.cc:330] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: stopping tablet replica
I20260809 15:41:06.780480 26346 raft_consensus.cc:2229] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:06.780798 26346 raft_consensus.cc:2258] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:06.781121 26345 raft_consensus.cc:2258] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:06.782342 26349 ts_tablet_manager.cc:1905] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:06.784785 26346 ts_tablet_manager.cc:1905] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:06.785714 26174 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd (DEFAULT_TABLE table=test-table [id=fdc27d41a3ba48889df109ef51111875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.785776 25773 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd (DEFAULT_TABLE table=test-table [id=fdc27d41a3ba48889df109ef51111875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.786015 26174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb898881d194e1297f56e1fcd97dbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.786042 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb898881d194e1297f56e1fcd97dbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.787634 26349 ts_tablet_manager.cc:1918] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:06.787736 26349 log.cc:1196] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/2ed5526ec080431caa428cde2aa5f4fd
I20260809 15:41:06.788072 26349 ts_tablet_manager.cc:1939] T 2ed5526ec080431caa428cde2aa5f4fd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting consensus metadata
I20260809 15:41:06.788444 26318 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Bootstrap starting.
I20260809 15:41:06.788501 26316 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Bootstrap starting.
I20260809 15:41:06.789418 26316 tablet_bootstrap.cc:654] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.789480 26318 tablet_bootstrap.cc:654] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.790731 25976 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd (DEFAULT_TABLE table=test-table [id=fdc27d41a3ba48889df109ef51111875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:06.790832 26318 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: No bootstrap required, opened a new log
I20260809 15:41:06.790905 26318 ts_tablet_manager.cc:1397] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:06.791052 25976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb898881d194e1297f56e1fcd97dbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.791378 26318 raft_consensus.cc:348] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.791493 26318 raft_consensus.cc:374] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.791539 26318 raft_consensus.cc:729] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.791597 26346 ts_tablet_manager.cc:1918] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:06.791695 26346 log.cc:1196] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/2ed5526ec080431caa428cde2aa5f4fd
I20260809 15:41:06.791664 26318 consensus_queue.cc:260] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.791900 26318 ts_tablet_manager.cc:1428] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:06.792022 26346 ts_tablet_manager.cc:1939] T 2ed5526ec080431caa428cde2aa5f4fd P 752e194fec1d43a6953416d00390ccec: Deleting consensus metadata
I20260809 15:41:06.793354 26315 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Bootstrap starting.
I20260809 15:41:06.794041 25550 catalog_manager.cc:4841] TS 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269): tablet 2ed5526ec080431caa428cde2aa5f4fd (table test-table [id=7294f3777a544288a7787f19e6b26084]) successfully deleted
I20260809 15:41:06.794402 26315 tablet_bootstrap.cc:654] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.794843 26345 ts_tablet_manager.cc:1905] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:06.795123 25553 catalog_manager.cc:4841] TS 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261): tablet 2ed5526ec080431caa428cde2aa5f4fd (table test-table [id=7294f3777a544288a7787f19e6b26084]) successfully deleted
I20260809 15:41:06.796712 26315 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: No bootstrap required, opened a new log
I20260809 15:41:06.796806 26315 ts_tablet_manager.cc:1397] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:06.797281 26315 raft_consensus.cc:348] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.797344 26345 ts_tablet_manager.cc:1918] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:06.797394 26315 raft_consensus.cc:374] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.797426 26315 raft_consensus.cc:729] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.797442 26345 log.cc:1196] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/2ed5526ec080431caa428cde2aa5f4fd
I20260809 15:41:06.797554 26315 consensus_queue.cc:260] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.797823 26315 ts_tablet_manager.cc:1428] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:06.797829 26345 ts_tablet_manager.cc:1939] T 2ed5526ec080431caa428cde2aa5f4fd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting consensus metadata
I20260809 15:41:06.798717 26316 tablet_bootstrap.cc:492] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: No bootstrap required, opened a new log
I20260809 15:41:06.798805 26316 ts_tablet_manager.cc:1397] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260809 15:41:06.799320 26316 raft_consensus.cc:348] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.799456 26316 raft_consensus.cc:374] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.799499 26316 raft_consensus.cc:729] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057bbd9b7a094f2096e9c19af5f102d4, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.799665 25555 catalog_manager.cc:4841] TS e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237): tablet 2ed5526ec080431caa428cde2aa5f4fd (table test-table [id=7294f3777a544288a7787f19e6b26084]) successfully deleted
I20260809 15:41:06.799649 26316 consensus_queue.cc:260] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.801532 26316 ts_tablet_manager.cc:1428] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260809 15:41:06.816880 26324 raft_consensus.cc:482] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:06.817070 26324 raft_consensus.cc:504] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.818392 26324 leader_election.cc:288] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:06.823333 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.818741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:38073 (local address 127.14.15.129:37269)
0809 15:41:06.818871 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.818876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.818892 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:41:06.818972 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.818979 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.819036 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.819116 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.819578 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.820370 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.822054 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.822721 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.822848 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.822919 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.823122 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.823198 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:41:06.823369 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.818560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37269 (local address 127.14.15.131:38073)
0809 15:41:06.818759 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.818778 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.818876 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.819242 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.819246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.819268 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.819427 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.819435 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.820500 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.820504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.821854 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.821865 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.822855 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.822859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.822976 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.823005 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.823093 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.823172 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 15:41:06.824002 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.819016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39597 (local address 127.14.15.130:38237)
0809 15:41:06.819132 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.819136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.819322 (+ 186us) server_negotiation.cc:407] Connection header received
0809 15:41:06.819530 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.819535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.819611 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.819670 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:06.820140 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.820952 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.822576 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.823181 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.823300 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.823358 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.823756 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.823846 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:41:06.824070 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb898881d194e1297f56e1fcd97dbdd" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:06.824227 25810 raft_consensus.cc:2454] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:06.824453 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.818648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38237 (local address 127.14.15.131:39597)
0809 15:41:06.819186 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.819203 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.819360 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.819823 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.819828 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.819851 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:06.819982 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.819991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.821105 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.821108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.822444 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.822454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.823431 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.823434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.823567 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.823606 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.824179 (+ 573us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.824271 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":77,"threads_started":1}
I20260809 15:41:06.824621 26107 leader_election.cc:302] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, 752e194fec1d43a6953416d00390ccec; no voters:
I20260809 15:41:06.824918 26324 raft_consensus.cc:2781] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:06.825003 26324 raft_consensus.cc:482] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:06.825062 26324 raft_consensus.cc:3037] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.825198 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb898881d194e1297f56e1fcd97dbdd" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" is_pre_election: true
I20260809 15:41:06.825454 26008 raft_consensus.cc:2454] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:06.826551 26324 raft_consensus.cc:504] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.826990 26324 leader_election.cc:288] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Requested vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:06.827284 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb898881d194e1297f56e1fcd97dbdd" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:06.827394 25810 raft_consensus.cc:3037] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.827464 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb898881d194e1297f56e1fcd97dbdd" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
I20260809 15:41:06.827585 26008 raft_consensus.cc:3037] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:06.828528 26008 raft_consensus.cc:2454] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 1.
I20260809 15:41:06.828542 25810 raft_consensus.cc:2454] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 1.
I20260809 15:41:06.828864 26107 leader_election.cc:302] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, 752e194fec1d43a6953416d00390ccec; no voters:
I20260809 15:41:06.829077 26324 raft_consensus.cc:2781] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:06.829337 26324 raft_consensus.cc:686] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 1 LEADER]: Becoming Leader. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Running, Role: LEADER
I20260809 15:41:06.829602 26324 consensus_queue.cc:237] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.832095 25575 catalog_manager.cc:5495] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec reported cstate change: term changed from 0 to 1, leader changed from <none> to 752e194fec1d43a6953416d00390ccec (127.14.15.131). New cstate: current_term: 1 leader_uuid: "752e194fec1d43a6953416d00390ccec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } health_report { overall_health: HEALTHY } } }
Aug 09 15:41:06 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290065, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.190@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:06.870386 26372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.860305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34203 (local address 127.0.0.1:43972)
0809 15:41:06.860639 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:06.860656 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:06.860786 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:06.861061 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:06.861064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:06.861639 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:06.861765 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.861773 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.862630 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.862634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.863533 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:06.863544 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.864019 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.864023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:06.864110 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.864711 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:06.864727 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:06.866834 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:06.868716 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.868725 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.868731 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.868988 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.869281 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:06.869283 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:06.869284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:06.869401 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:06.869807 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:06.869813 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:06.869926 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 15:41:06.870032 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 15:41:06.870160 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":114,"threads_started":1}
I20260809 15:41:06.870419 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:06.860384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43972 (local address 127.14.15.190:34203)
0809 15:41:06.860544 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:06.860549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:06.860745 (+ 196us) server_negotiation.cc:407] Connection header received
0809 15:41:06.860884 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:06.860886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:06.860928 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:06.861008 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:06.861897 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.862522 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.863679 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:06.863899 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:06.863991 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:06.866996 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:06.867001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:06.867004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:06.867031 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:06.868600 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.869092 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.869095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.869097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.869184 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:06.869486 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:06.869489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:06.869490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:06.869707 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:06.869800 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:06.870088 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 15:41:06.870253 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 15:41:06.874809 25575 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43972:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:41:06.875674 25575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:06.881129 25976 tablet_service.cc:1467] Processing CreateTablet for tablet d57b7a32f27d438ea9575981166c0b88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c95a3569c219440883d742e4e0a8597e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:41:06.881129 25773 tablet_service.cc:1467] Processing CreateTablet for tablet d57b7a32f27d438ea9575981166c0b88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c95a3569c219440883d742e4e0a8597e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:41:06.881278 26174 tablet_service.cc:1467] Processing CreateTablet for tablet d57b7a32f27d438ea9575981166c0b88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c95a3569c219440883d742e4e0a8597e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:41:06.881544 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d57b7a32f27d438ea9575981166c0b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.881544 25976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d57b7a32f27d438ea9575981166c0b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.881683 26174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d57b7a32f27d438ea9575981166c0b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:06.884740 26315 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Bootstrap starting.
I20260809 15:41:06.884796 26316 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: Bootstrap starting.
I20260809 15:41:06.886040 26316 tablet_bootstrap.cc:654] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.886128 26315 tablet_bootstrap.cc:654] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.886936 26318 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: Bootstrap starting.
I20260809 15:41:06.887923 26318 tablet_bootstrap.cc:654] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:06.888065 26316 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: No bootstrap required, opened a new log
I20260809 15:41:06.888195 26316 ts_tablet_manager.cc:1397] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 15:41:06.888684 26316 raft_consensus.cc:348] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.888937 26316 raft_consensus.cc:374] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.888983 26316 raft_consensus.cc:729] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057bbd9b7a094f2096e9c19af5f102d4, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.889191 26316 consensus_queue.cc:260] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.889478 26323 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:06.889624 26323 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:06.889660 26318 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: No bootstrap required, opened a new log
I20260809 15:41:06.889744 26318 ts_tablet_manager.cc:1397] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:06.889976 26315 tablet_bootstrap.cc:492] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: No bootstrap required, opened a new log
I20260809 15:41:06.890067 26315 ts_tablet_manager.cc:1397] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 15:41:06.890547 26315 raft_consensus.cc:348] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.890544 26318 raft_consensus.cc:348] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.890673 26315 raft_consensus.cc:374] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.890686 26316 ts_tablet_manager.cc:1428] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 15:41:06.890692 26318 raft_consensus.cc:374] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:06.890705 26315 raft_consensus.cc:729] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.890729 26318 raft_consensus.cc:729] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Initialized, Role: FOLLOWER
I20260809 15:41:06.890827 26315 consensus_queue.cc:260] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.890858 26318 consensus_queue.cc:260] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:06.891178 26318 ts_tablet_manager.cc:1428] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:06.891108 26342 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:06.891268 26342 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:06.891120 26315 ts_tablet_manager.cc:1428] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:41:06.892349 26324 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:06.892479 26324 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:07.019829 26342 raft_consensus.cc:482] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:07.020020 26342 raft_consensus.cc:504] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.020565 26342 leader_election.cc:288] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261)
I20260809 15:41:07.021030 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d57b7a32f27d438ea9575981166c0b88" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:07.021209 25810 raft_consensus.cc:2454] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:07.021131 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d57b7a32f27d438ea9575981166c0b88" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec" is_pre_election: true
I20260809 15:41:07.021358 26207 raft_consensus.cc:2454] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:07.021550 25908 leader_election.cc:302] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:07.021754 26342 raft_consensus.cc:2781] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:07.021837 26342 raft_consensus.cc:482] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:07.021874 26342 raft_consensus.cc:3037] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.023079 26342 raft_consensus.cc:504] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.023428 26342 leader_election.cc:288] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261)
I20260809 15:41:07.023895 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d57b7a32f27d438ea9575981166c0b88" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec"
I20260809 15:41:07.023895 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d57b7a32f27d438ea9575981166c0b88" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:07.024045 25810 raft_consensus.cc:3037] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.024045 26207 raft_consensus.cc:3037] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.025274 25810 raft_consensus.cc:2454] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 1.
I20260809 15:41:07.025274 26207 raft_consensus.cc:2454] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 1.
I20260809 15:41:07.025609 25911 leader_election.cc:302] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752e194fec1d43a6953416d00390ccec, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:07.025810 26342 raft_consensus.cc:2781] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:07.025920 26342 raft_consensus.cc:686] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 LEADER]: Becoming Leader. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Running, Role: LEADER
I20260809 15:41:07.026067 26342 consensus_queue.cc:237] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.027185 26338 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: TxnStatusTablet state changed. Reason: New leader e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.027307 26338 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:41:07.027794 26379 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:41:07.027992 26379 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:41:07.028203 25574 catalog_manager.cc:5495] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260809 15:41:07.054168 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.050577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49396 (local address 127.14.15.130:38237)
0809 15:41:07.050715 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.050718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.050732 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:07.050920 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.050922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.050973 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.051037 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.051337 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.051848 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.053092 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.053303 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.053382 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.053726 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.053803 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.053858 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.054006 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.054055 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:41:07.054253 26372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.050432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38237 (local address 127.0.0.1:49396)
0809 15:41:07.050643 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:07.050659 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:07.050790 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:07.051095 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:07.051098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:07.051108 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:41:07.051228 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.051235 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.051968 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.051971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.052962 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.052973 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.053420 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.053424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.053521 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.053583 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.053895 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.053910 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 15:41:07.053988 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:41:07.054082 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 15:41:07.056972 25810 raft_consensus.cc:1261] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.056993 26207 raft_consensus.cc:1261] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.057426 26338 consensus_queue.cc:1035] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.057657 26342 consensus_queue.cc:1035] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.059084 26324 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: TxnStatusTablet state changed. Reason: New leader e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.059206 26324 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:07.059301 26323 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: TxnStatusTablet state changed. Reason: New leader e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.059427 26323 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:07.060804 26343 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.061254 26343 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:41:07.062609 26338 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.062721 26338 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:41:07.063458 26334 mvcc.cc:205] Tried to move back new op lower bound from 7316644114660741120 to 7316644114540470272. Current Snapshot: MvccSnapshot[applied={T|T < 7316644114660741120 or (T in {7316644114660741120})}]
I20260809 15:41:07.063683 26323 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.063782 26323 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 057bbd9b7a094f2096e9c19af5f102d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:07.064433 26335 mvcc.cc:205] Tried to move back new op lower bound from 7316644114660741120 to 7316644114540470272. Current Snapshot: MvccSnapshot[applied={T|T < 7316644114660741120}]
I20260809 15:41:07.064647 26324 tablet_replica.cc:439] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } } }
I20260809 15:41:07.064770 26324 tablet_replica.cc:442] T d57b7a32f27d438ea9575981166c0b88 P 752e194fec1d43a6953416d00390ccec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:41:07.071444 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.067337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.14.15.131:43261)
0809 15:41:07.067452 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.067457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.067471 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:07.067618 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.067621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.067682 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.067798 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.068001 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.068765 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.069613 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.069990 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.070088 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.070394 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.071010 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.071129 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.071187 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.071248 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:41:07.083828 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.079791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:58215 (local address 127.14.15.130:38237)
0809 15:41:07.079923 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.079926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.080180 (+ 254us) server_negotiation.cc:407] Connection header received
0809 15:41:07.080360 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.080363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.080416 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.080490 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.080778 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.081284 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.082582 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.082834 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.082923 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.083259 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.083336 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.083394 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.083668 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.083722 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:41:07.083774 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.079710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38237 (local address 127.14.15.131:58215)
0809 15:41:07.080088 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:07.080103 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:07.080217 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:07.080523 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:07.080527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:07.080534 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:41:07.080667 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.080674 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.081396 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.081400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.082437 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.082449 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.082947 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.082951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.083065 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.083124 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.083421 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.083428 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:41:07.083497 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 15:41:07.083585 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":107,"threads_started":1}
I20260809 15:41:07.091286 25810 raft_consensus.cc:1261] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Refusing update from remote peer 752e194fec1d43a6953416d00390ccec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.091334 26008 raft_consensus.cc:1261] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Refusing update from remote peer 752e194fec1d43a6953416d00390ccec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.091919 26357 consensus_queue.cc:1035] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [LEADER]: Connected to new peer: Peer: permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.092216 26324 consensus_queue.cc:1035] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.099740 26333 mvcc.cc:205] Tried to move back new op lower bound from 7316644114799636480 to 7316644113736810496. Current Snapshot: MvccSnapshot[applied={T|T < 7316644114799636480}]
I20260809 15:41:07.120398 26396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.115297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43261 (local address 127.14.15.130:53035)
0809 15:41:07.115881 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:07.115895 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:07.116039 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:07.116345 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:07.116348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:07.116358 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:41:07.116697 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.116707 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.117548 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.117552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.118740 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.118752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.119381 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.119386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.119491 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.119552 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.120061 (+ 509us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.120071 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 15:41:07.120152 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:41:07.120244 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":148,"threads_started":1}
I20260809 15:41:07.120395 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.115351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53035 (local address 127.14.15.131:43261)
0809 15:41:07.115709 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.115714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.115983 (+ 269us) server_negotiation.cc:407] Connection header received
0809 15:41:07.116161 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.116165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.116223 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.116307 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.116812 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.117413 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.118895 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.119234 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.119381 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.119871 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.119962 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.120051 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.120174 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.120236 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271}
I20260809 15:41:07.149330 25569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.149547 25569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.151865 25569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Sending DeleteTablet for 3 replicas of tablet 9cb898881d194e1297f56e1fcd97dbdd
I20260809 15:41:07.152736 26174 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37642
I20260809 15:41:07.152773 25773 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46234
I20260809 15:41:07.152968 26346 tablet_replica.cc:330] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: stopping tablet replica
I20260809 15:41:07.152972 25976 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb898881d194e1297f56e1fcd97dbdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49386
I20260809 15:41:07.153117 26346 raft_consensus.cc:2229] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:07.153406 26349 tablet_replica.cc:330] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: stopping tablet replica
I20260809 15:41:07.153460 26346 raft_consensus.cc:2258] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.153555 26349 raft_consensus.cc:2229] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.153713 26349 raft_consensus.cc:2258] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.153904 26345 tablet_replica.cc:330] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: stopping tablet replica
I20260809 15:41:07.154031 26345 raft_consensus.cc:2229] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.154174 26345 raft_consensus.cc:2258] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.155078 26346 ts_tablet_manager.cc:1905] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.155265 26345 ts_tablet_manager.cc:1905] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.157984 26346 ts_tablet_manager.cc:1918] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:41:07.157984 26345 ts_tablet_manager.cc:1918] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:41:07.158059 26346 log.cc:1196] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/9cb898881d194e1297f56e1fcd97dbdd
I20260809 15:41:07.158059 26345 log.cc:1196] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/9cb898881d194e1297f56e1fcd97dbdd
I20260809 15:41:07.158360 26346 ts_tablet_manager.cc:1939] T 9cb898881d194e1297f56e1fcd97dbdd P 752e194fec1d43a6953416d00390ccec: Deleting consensus metadata
I20260809 15:41:07.158360 26345 ts_tablet_manager.cc:1939] T 9cb898881d194e1297f56e1fcd97dbdd P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting consensus metadata
I20260809 15:41:07.159554 25555 catalog_manager.cc:4841] TS e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237): tablet 9cb898881d194e1297f56e1fcd97dbdd (table test-table [id=fdc27d41a3ba48889df109ef51111875]) successfully deleted
I20260809 15:41:07.160475 26349 ts_tablet_manager.cc:1905] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.162686 25553 catalog_manager.cc:4841] TS 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261): tablet 9cb898881d194e1297f56e1fcd97dbdd (table test-table [id=fdc27d41a3ba48889df109ef51111875]) successfully deleted
I20260809 15:41:07.163905 26349 ts_tablet_manager.cc:1918] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:41:07.164012 26349 log.cc:1196] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/9cb898881d194e1297f56e1fcd97dbdd
I20260809 15:41:07.164264 26349 ts_tablet_manager.cc:1939] T 9cb898881d194e1297f56e1fcd97dbdd P 057bbd9b7a094f2096e9c19af5f102d4: Deleting consensus metadata
I20260809 15:41:07.165051 25550 catalog_manager.cc:4841] TS 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269): tablet 9cb898881d194e1297f56e1fcd97dbdd (table test-table [id=fdc27d41a3ba48889df109ef51111875]) successfully deleted
Aug 09 15:41:07 dist-test-slave-jztv krb5kdc[25505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:41:07 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:07 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:41:07.190900 25655 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:07.183835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43976 (local address 127.14.15.190:34203)
0809 15:41:07.183987 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.183992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.184241 (+ 249us) server_negotiation.cc:407] Connection header received
0809 15:41:07.184417 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.184420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.184477 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.184567 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:07.185355 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.185984 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.187126 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.187358 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.187473 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.190757 (+ 3284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43976: BlockingRecv error: recv got EOF from 127.0.0.1:43976 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 15:41:07 dist-test-slave-jztv krb5kdc[25505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM
I20260809 15:41:07.201721 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.192864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.14.15.190:34203)
0809 15:41:07.192980 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.192985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.193316 (+ 331us) server_negotiation.cc:407] Connection header received
0809 15:41:07.193462 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.193466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.193519 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.193602 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:07.194297 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.194810 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.195609 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.195838 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.195954 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.198328 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:07.198332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:07.198337 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:07.198370 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:07.200002 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:07.200449 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:07.200453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:07.200454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:07.200540 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:07.200823 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:07.200827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:07.200829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:07.201030 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:07.201174 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.201425 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.201547 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 15:41:07.204523 25569 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:07.205026 25569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:07.210132 25773 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc (DEFAULT_TABLE table=test-table [id=0d5450ab39a14f2d93129850570e60f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.210383 26174 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc (DEFAULT_TABLE table=test-table [id=0d5450ab39a14f2d93129850570e60f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.210501 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e9666a22844c181ff6cafe90a02dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.210668 26174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e9666a22844c181ff6cafe90a02dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.212998 26318 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Bootstrap starting.
I20260809 15:41:07.213851 25976 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc (DEFAULT_TABLE table=test-table [id=0d5450ab39a14f2d93129850570e60f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.213949 26318 tablet_bootstrap.cc:654] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.214148 25976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e9666a22844c181ff6cafe90a02dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.214599 26316 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Bootstrap starting.
I20260809 15:41:07.215476 26316 tablet_bootstrap.cc:654] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.216389 26315 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Bootstrap starting.
I20260809 15:41:07.216612 26318 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: No bootstrap required, opened a new log
I20260809 15:41:07.216702 26318 ts_tablet_manager.cc:1397] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260809 15:41:07.217131 26315 tablet_bootstrap.cc:654] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.217115 26318 raft_consensus.cc:348] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.217214 26318 raft_consensus.cc:374] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.217253 26318 raft_consensus.cc:729] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.217382 26318 consensus_queue.cc:260] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.217684 26318 ts_tablet_manager.cc:1428] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:41:07.218467 26315 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: No bootstrap required, opened a new log
I20260809 15:41:07.218572 26315 ts_tablet_manager.cc:1397] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 15:41:07.219015 26315 raft_consensus.cc:348] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.219082 26316 tablet_bootstrap.cc:492] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: No bootstrap required, opened a new log
I20260809 15:41:07.219128 26315 raft_consensus.cc:374] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.219161 26315 raft_consensus.cc:729] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.219166 26316 ts_tablet_manager.cc:1397] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 15:41:07.219300 26315 consensus_queue.cc:260] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.219560 26315 ts_tablet_manager.cc:1428] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:41:07.219636 26316 raft_consensus.cc:348] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.219754 26316 raft_consensus.cc:374] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.219789 26316 raft_consensus.cc:729] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057bbd9b7a094f2096e9c19af5f102d4, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.219916 26316 consensus_queue.cc:260] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.220170 26316 ts_tablet_manager.cc:1428] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:07.434965 26357 raft_consensus.cc:482] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:07.435137 26357 raft_consensus.cc:504] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.435578 26357 leader_election.cc:288] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:07.436264 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e9666a22844c181ff6cafe90a02dc" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:07.436264 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e9666a22844c181ff6cafe90a02dc" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" is_pre_election: true
I20260809 15:41:07.436441 26008 raft_consensus.cc:2454] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:07.436442 25810 raft_consensus.cc:2454] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:07.436858 26107 leader_election.cc:302] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, 752e194fec1d43a6953416d00390ccec; no voters:
I20260809 15:41:07.437088 26357 raft_consensus.cc:2781] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:07.437161 26357 raft_consensus.cc:482] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:07.437218 26357 raft_consensus.cc:3037] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.438335 26357 raft_consensus.cc:504] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.438748 26357 leader_election.cc:288] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Requested vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:07.439157 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e9666a22844c181ff6cafe90a02dc" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
I20260809 15:41:07.439155 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e9666a22844c181ff6cafe90a02dc" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:07.439313 26008 raft_consensus.cc:3037] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.439328 25810 raft_consensus.cc:3037] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.440303 25810 raft_consensus.cc:2454] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 1.
I20260809 15:41:07.440307 26008 raft_consensus.cc:2454] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 1.
I20260809 15:41:07.440647 26107 leader_election.cc:302] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, 752e194fec1d43a6953416d00390ccec; no voters:
I20260809 15:41:07.440846 26357 raft_consensus.cc:2781] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:07.440989 26357 raft_consensus.cc:686] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 1 LEADER]: Becoming Leader. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Running, Role: LEADER
I20260809 15:41:07.441152 26357 consensus_queue.cc:237] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.442986 25570 catalog_manager.cc:5495] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec reported cstate change: term changed from 0 to 1, leader changed from <none> to 752e194fec1d43a6953416d00390ccec (127.14.15.131). New cstate: current_term: 1 leader_uuid: "752e194fec1d43a6953416d00390ccec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260809 15:41:07.459340 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.455824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37656 (local address 127.14.15.131:43261)
0809 15:41:07.455962 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.455966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.455980 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:07.456096 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.456098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.456144 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.456210 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.456477 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.456982 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.458199 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.458498 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.458584 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.458861 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.458938 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.458991 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.459119 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.459166 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:41:07.461544 26008 raft_consensus.cc:1261] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Refusing update from remote peer 752e194fec1d43a6953416d00390ccec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.461586 25810 raft_consensus.cc:1261] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Refusing update from remote peer 752e194fec1d43a6953416d00390ccec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.462040 26357 consensus_queue.cc:1035] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.462188 26391 consensus_queue.cc:1035] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [LEADER]: Connected to new peer: Peer: permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.470275 25569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.470445 25569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.473155 25569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Sending DeleteTablet for 3 replicas of tablet 3e2e9666a22844c181ff6cafe90a02dc
I20260809 15:41:07.473668 26174 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37642
I20260809 15:41:07.473874 25773 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46234
I20260809 15:41:07.474071 26346 tablet_replica.cc:330] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: stopping tablet replica
I20260809 15:41:07.474201 26346 raft_consensus.cc:2229] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:07.474248 25976 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49386
I20260809 15:41:07.474422 26346 raft_consensus.cc:2258] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.474462 26345 tablet_replica.cc:330] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: stopping tablet replica
I20260809 15:41:07.474594 26349 tablet_replica.cc:330] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: stopping tablet replica
I20260809 15:41:07.474586 26345 raft_consensus.cc:2229] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.474699 26349 raft_consensus.cc:2229] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.474713 26345 raft_consensus.cc:2258] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.474831 26349 raft_consensus.cc:2258] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.475409 26345 ts_tablet_manager.cc:1905] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.475570 26349 ts_tablet_manager.cc:1905] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.475684 26174 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37642
I20260809 15:41:07.475962 26346 ts_tablet_manager.cc:1905] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.476029 25976 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e9666a22844c181ff6cafe90a02dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49386
I20260809 15:41:07.477759 26345 ts_tablet_manager.cc:1918] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:07.477815 26345 log.cc:1196] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/3e2e9666a22844c181ff6cafe90a02dc
I20260809 15:41:07.478121 26345 ts_tablet_manager.cc:1939] T 3e2e9666a22844c181ff6cafe90a02dc P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting consensus metadata
I20260809 15:41:07.478179 26349 ts_tablet_manager.cc:1918] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:07.478340 26349 log.cc:1196] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/3e2e9666a22844c181ff6cafe90a02dc
I20260809 15:41:07.478453 26346 ts_tablet_manager.cc:1918] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:07.478542 26346 log.cc:1196] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/3e2e9666a22844c181ff6cafe90a02dc
I20260809 15:41:07.478621 26349 ts_tablet_manager.cc:1939] T 3e2e9666a22844c181ff6cafe90a02dc P 057bbd9b7a094f2096e9c19af5f102d4: Deleting consensus metadata
I20260809 15:41:07.478804 26346 ts_tablet_manager.cc:1939] T 3e2e9666a22844c181ff6cafe90a02dc P 752e194fec1d43a6953416d00390ccec: Deleting consensus metadata
I20260809 15:41:07.479148 25555 catalog_manager.cc:4841] TS e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237): tablet 3e2e9666a22844c181ff6cafe90a02dc (table test-table [id=0d5450ab39a14f2d93129850570e60f3]) successfully deleted
I20260809 15:41:07.479307 25550 catalog_manager.cc:4841] TS 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269): tablet 3e2e9666a22844c181ff6cafe90a02dc (table test-table [id=0d5450ab39a14f2d93129850570e60f3]) successfully deleted
I20260809 15:41:07.479629 25569 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:07.479815 25555 catalog_manager.cc:4808] TS e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237): delete failed for tablet 3e2e9666a22844c181ff6cafe90a02dc because the tablet was not found. No further retry: Not found: Tablet not found: 3e2e9666a22844c181ff6cafe90a02dc
W20260809 15:41:07.480072 25569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:07.481556 25553 catalog_manager.cc:4841] TS 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261): tablet 3e2e9666a22844c181ff6cafe90a02dc (table test-table [id=0d5450ab39a14f2d93129850570e60f3]) successfully deleted
W20260809 15:41:07.481724 25553 catalog_manager.cc:4808] TS 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261): delete failed for tablet 3e2e9666a22844c181ff6cafe90a02dc because the tablet was not found. No further retry: Not found: Tablet not found: 3e2e9666a22844c181ff6cafe90a02dc
I20260809 15:41:07.484949 25773 tablet_service.cc:1467] Processing CreateTablet for tablet 898adee13e1d4b4f81a59c18fda446ba (DEFAULT_TABLE table=test-table [id=0dbcef6bcf0d429c8b8d302bc5160a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.485075 25976 tablet_service.cc:1467] Processing CreateTablet for tablet 898adee13e1d4b4f81a59c18fda446ba (DEFAULT_TABLE table=test-table [id=0dbcef6bcf0d429c8b8d302bc5160a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.485265 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898adee13e1d4b4f81a59c18fda446ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.485323 25976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898adee13e1d4b4f81a59c18fda446ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.487813 26316 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: Bootstrap starting.
I20260809 15:41:07.487813 26315 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Bootstrap starting.
I20260809 15:41:07.487910 26174 tablet_service.cc:1467] Processing CreateTablet for tablet 898adee13e1d4b4f81a59c18fda446ba (DEFAULT_TABLE table=test-table [id=0dbcef6bcf0d429c8b8d302bc5160a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:07.488142 26174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898adee13e1d4b4f81a59c18fda446ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:07.488813 26316 tablet_bootstrap.cc:654] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.488813 26315 tablet_bootstrap.cc:654] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.490011 26315 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: No bootstrap required, opened a new log
I20260809 15:41:07.490098 26315 ts_tablet_manager.cc:1397] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 15:41:07.490278 26318 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Bootstrap starting.
I20260809 15:41:07.490571 26315 raft_consensus.cc:348] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.490713 26315 raft_consensus.cc:374] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.490748 26315 raft_consensus.cc:729] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.490872 26315 consensus_queue.cc:260] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.491186 26318 tablet_bootstrap.cc:654] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:07.491189 26315 ts_tablet_manager.cc:1428] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:41:07.492147 26316 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: No bootstrap required, opened a new log
I20260809 15:41:07.492247 26316 ts_tablet_manager.cc:1397] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 15:41:07.492385 26318 tablet_bootstrap.cc:492] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: No bootstrap required, opened a new log
I20260809 15:41:07.492476 26318 ts_tablet_manager.cc:1397] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 15:41:07.492758 26316 raft_consensus.cc:348] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.492888 26316 raft_consensus.cc:374] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.492923 26316 raft_consensus.cc:729] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057bbd9b7a094f2096e9c19af5f102d4, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.492856 26318 raft_consensus.cc:348] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.492962 26318 raft_consensus.cc:374] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:07.493007 26318 raft_consensus.cc:729] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752e194fec1d43a6953416d00390ccec, State: Initialized, Role: FOLLOWER
I20260809 15:41:07.493083 26316 consensus_queue.cc:260] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.493130 26318 consensus_queue.cc:260] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.493383 26318 ts_tablet_manager.cc:1428] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:41:07.493383 26316 ts_tablet_manager.cc:1428] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:41:07.827080 26343 raft_consensus.cc:482] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:07.827302 26391 raft_consensus.cc:482] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:07.827280 26343 raft_consensus.cc:504] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.827466 26391 raft_consensus.cc:504] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.827840 26343 leader_election.cc:288] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261)
I20260809 15:41:07.827962 26391 leader_election.cc:288] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:07.828336 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec" is_pre_election: true
I20260809 15:41:07.828478 26207 raft_consensus.cc:2454] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:07.828497 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" is_pre_election: true
I20260809 15:41:07.828495 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:07.828634 25810 raft_consensus.cc:2454] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 0.
I20260809 15:41:07.828631 26008 raft_consensus.cc:2454] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:07.828863 25911 leader_election.cc:302] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752e194fec1d43a6953416d00390ccec, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:07.828907 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4" is_pre_election: true
I20260809 15:41:07.829023 25810 raft_consensus.cc:2454] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 752e194fec1d43a6953416d00390ccec in term 0.
I20260809 15:41:07.829250 26343 raft_consensus.cc:2781] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:07.829255 26110 leader_election.cc:302] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 752e194fec1d43a6953416d00390ccec, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters:
I20260809 15:41:07.829319 26343 raft_consensus.cc:482] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:07.829366 26343 raft_consensus.cc:3037] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.829464 26391 raft_consensus.cc:2781] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:07.829533 26391 raft_consensus.cc:482] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:07.829576 26391 raft_consensus.cc:3037] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.830470 26343 raft_consensus.cc:504] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.830611 26391 raft_consensus.cc:504] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.830811 26343 leader_election.cc:288] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261)
I20260809 15:41:07.830951 26391 leader_election.cc:288] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Requested vote from peers 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269), e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237)
I20260809 15:41:07.831192 25810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:07.831219 25809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057bbd9b7a094f2096e9c19af5f102d4"
I20260809 15:41:07.831317 25810 raft_consensus.cc:3037] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:07.831280 26207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "752e194fec1d43a6953416d00390ccec"
I20260809 15:41:07.831338 26008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898adee13e1d4b4f81a59c18fda446ba" candidate_uuid: "752e194fec1d43a6953416d00390ccec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5"
I20260809 15:41:07.831451 26207 raft_consensus.cc:2379] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in current term 1: Already voted for candidate 752e194fec1d43a6953416d00390ccec in this term.
I20260809 15:41:07.831480 26008 raft_consensus.cc:2379] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 752e194fec1d43a6953416d00390ccec in current term 1: Already voted for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in this term.
I20260809 15:41:07.831758 26110 leader_election.cc:302] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 752e194fec1d43a6953416d00390ccec; no voters: 057bbd9b7a094f2096e9c19af5f102d4, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5
I20260809 15:41:07.831939 26391 raft_consensus.cc:2726] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 15:41:07.832406 25810 raft_consensus.cc:2454] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 in term 1.
I20260809 15:41:07.832719 25908 leader_election.cc:302] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 057bbd9b7a094f2096e9c19af5f102d4, e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5; no voters: 752e194fec1d43a6953416d00390ccec
I20260809 15:41:07.832970 26343 raft_consensus.cc:2781] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:07.833178 26343 raft_consensus.cc:686] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 LEADER]: Becoming Leader. State: Replica: e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5, State: Running, Role: LEADER
I20260809 15:41:07.833344 26343 consensus_queue.cc:237] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } }
I20260809 15:41:07.835040 25570 catalog_manager.cc:5495] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260809 15:41:07.865334 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.862101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49404 (local address 127.14.15.130:38237)
0809 15:41:07.862363 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.862367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.862381 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:07.862498 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.862510 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.862556 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.862650 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.862898 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.863436 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.864257 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.864492 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.864604 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.864861 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.864945 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.865026 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.865118 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.865174 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
I20260809 15:41:07.873974 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.871094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56831 (local address 127.14.15.130:38237)
0809 15:41:07.871213 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:07.871217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:07.871352 (+ 135us) server_negotiation.cc:407] Connection header received
0809 15:41:07.871462 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:07.871464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:07.871522 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:07.871584 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:07.871785 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.872265 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.873038 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.873250 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.873323 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.873567 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.873632 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.873683 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:07.873801 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 15:41:07.873858 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":49}
I20260809 15:41:07.873986 26437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.870993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38237 (local address 127.14.15.130:56831)
0809 15:41:07.871271 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:07.871284 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:07.871371 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:07.871610 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:07.871612 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:07.871619 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:41:07.871700 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.871703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.872354 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.872356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.872940 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:07.872948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:07.873355 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:07.873358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:07.873441 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:07.873467 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:41:07.873715 (+ 248us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:41:07.873721 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:41:07.873777 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 15:41:07.873871 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":16,"thread_start_us":102,"threads_started":1}
I20260809 15:41:07.880051 25810 raft_consensus.cc:1261] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.880149 26207 raft_consensus.cc:1261] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Refusing update from remote peer e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:07.880457 26431 consensus_queue.cc:1035] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "057bbd9b7a094f2096e9c19af5f102d4" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.880611 26343 consensus_queue.cc:1035] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "752e194fec1d43a6953416d00390ccec" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:07.912636 25570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.912812 25570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:07.914817 25570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52b6f58f6045468290b95dd8cb6eee74: Sending DeleteTablet for 3 replicas of tablet 898adee13e1d4b4f81a59c18fda446ba
I20260809 15:41:07.915426 25773 tablet_service.cc:1514] Processing DeleteTablet for tablet 898adee13e1d4b4f81a59c18fda446ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46234
I20260809 15:41:07.915622 25975 tablet_service.cc:1514] Processing DeleteTablet for tablet 898adee13e1d4b4f81a59c18fda446ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49386
I20260809 15:41:07.915658 26174 tablet_service.cc:1514] Processing DeleteTablet for tablet 898adee13e1d4b4f81a59c18fda446ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:07 UTC) from {username='oryx', principal='oryx/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37642
I20260809 15:41:07.915753 26349 tablet_replica.cc:330] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: stopping tablet replica
I20260809 15:41:07.915822 26345 tablet_replica.cc:330] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: stopping tablet replica
I20260809 15:41:07.915827 26346 tablet_replica.cc:330] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: stopping tablet replica
I20260809 15:41:07.915884 26349 raft_consensus.cc:2229] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.915946 26346 raft_consensus.cc:2229] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:07.915959 26345 raft_consensus.cc:2229] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:41:07.916019 26349 raft_consensus.cc:2258] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.916061 26346 raft_consensus.cc:2258] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.916162 26345 raft_consensus.cc:2258] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:07.916765 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 25682
I20260809 15:41:07.916868 26345 ts_tablet_manager.cc:1905] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.916862 26349 ts_tablet_manager.cc:1905] T 898adee13e1d4b4f81a59c18fda446ba P 057bbd9b7a094f2096e9c19af5f102d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.919826 26345 ts_tablet_manager.cc:1918] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:41:07.919889 26345 log.cc:1196] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/898adee13e1d4b4f81a59c18fda446ba
I20260809 15:41:07.920110 26345 ts_tablet_manager.cc:1939] T 898adee13e1d4b4f81a59c18fda446ba P e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5: Deleting consensus metadata
I20260809 15:41:07.926649 25555 catalog_manager.cc:4841] TS e0ea7ae7d9ca4e2fba6f3cac1ad6d8f5 (127.14.15.130:38237): tablet 898adee13e1d4b4f81a59c18fda446ba (table test-table [id=0dbcef6bcf0d429c8b8d302bc5160a0a]) successfully deleted
I20260809 15:41:07.933468 26346 ts_tablet_manager.cc:1905] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:07.935732 26346 ts_tablet_manager.cc:1918] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:41:07.935843 26346 log.cc:1196] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/898adee13e1d4b4f81a59c18fda446ba
I20260809 15:41:07.936081 26346 ts_tablet_manager.cc:1939] T 898adee13e1d4b4f81a59c18fda446ba P 752e194fec1d43a6953416d00390ccec: Deleting consensus metadata
I20260809 15:41:07.936892 25553 catalog_manager.cc:4841] TS 752e194fec1d43a6953416d00390ccec (127.14.15.131:43261): tablet 898adee13e1d4b4f81a59c18fda446ba (table test-table [id=0dbcef6bcf0d429c8b8d302bc5160a0a]) successfully deleted
W20260809 15:41:07.938815 25550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:37269 (error 108)
I20260809 15:41:07.939742 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 25883
I20260809 15:41:07.940032 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:07.939556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37269 (local address 127.0.0.1:46248)
0809 15:41:07.939796 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:07.939899 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":93,"threads_started":1}
W20260809 15:41:07.946074 25550 catalog_manager.cc:4584] TS 057bbd9b7a094f2096e9c19af5f102d4 (127.14.15.129:37269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 898adee13e1d4b4f81a59c18fda446ba: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37269: connect: Connection refused (error 111)
I20260809 15:41:07.957239 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 26083
I20260809 15:41:07.972122 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 25524
2026-08-09T15:41:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3931 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:41:08 dist-test-slave-jztv krb5kdc[26452](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:41:08 dist-test-slave-jztv krb5kdc[26452](info): set up 2 sockets
Aug 09 15:41:08 dist-test-slave-jztv krb5kdc[26452](info): commencing operation
krb5kdc: starting...
W20260809 15:41:09.239223 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:41:09 dist-test-slave-jztv krb5kdc[26452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:41:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:41:09.369258 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36855
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:37273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:36855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:09.483901 26472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:09.484236 26472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:09.484316 26472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:09.489101 26472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:09.489187 26472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:09.489225 26472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:09.489262 26472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:09.489297 26472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:09.495021 26472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:37273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:36855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:09.496155 26472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:09.497198 26472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:09.505848 26482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:09.505867 26483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:09.506050 26472 server_base.cc:1034] running on GCE node
W20260809 15:41:09.505890 26486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:09.506771 26472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:09.507899 26472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:09.509091 26472 hybrid_clock.cc:648] HybridClock initialized: now 1786290069509078 us; error 24 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T15:41:09Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1531 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:41:09 dist-test-slave-jztv krb5kdc[26492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:41:09 dist-test-slave-jztv krb5kdc[26492](info): set up 2 sockets
Aug 09 15:41:09 dist-test-slave-jztv krb5kdc[26492](info): commencing operation
krb5kdc: starting...
W20260809 15:41:10.752460 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:41:10 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:41:10.883368 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42553
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:10.997408 26514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:10.997679 26514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:10.997754 26514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:11.001787 26514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:11.001850 26514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:11.001870 26514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:11.001888 26514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:11.001902 26514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:11.007258 26514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:42553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:11.008332 26514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:11.009369 26514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:11.018153 26535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.018150 26533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:11.018330 26514 server_base.cc:1034] running on GCE node
W20260809 15:41:11.018517 26531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:11.019114 26514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:11.020256 26514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:11.021489 26514 hybrid_clock.cc:648] HybridClock initialized: now 1786290071021457 us; error 44 us; skew 500 ppm
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:11.028206 26514 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:41:11.029217 26514 webserver.cc:460] Webserver started at http://127.14.15.190:44649/ using document root <none> and password file <none>
I20260809 15:41:11.029816 26514 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:11.029912 26514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:11.030164 26514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:11.032303 26514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "a38dcc5963884c018e1937ef98c920ae"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "3cd3bc2aae7f29c093058102f71268a4"
server_key_iv: "4f1420d44810f35fafb9ab358de2936b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.032977 26514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "a38dcc5963884c018e1937ef98c920ae"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "3cd3bc2aae7f29c093058102f71268a4"
server_key_iv: "4f1420d44810f35fafb9ab358de2936b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.036859 26514 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:41:11.039430 26547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.040673 26514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:11.040827 26514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "a38dcc5963884c018e1937ef98c920ae"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "3cd3bc2aae7f29c093058102f71268a4"
server_key_iv: "4f1420d44810f35fafb9ab358de2936b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.040951 26514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:11.055996 26514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:11.059263 26514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:11.059518 26514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:11.067004 26514 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:42553
I20260809 15:41:11.067034 26617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:42553 every 8 connection(s)
I20260809 15:41:11.068017 26514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:11.070148 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 26514
I20260809 15:41:11.070322 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:41:11.070652 14398 external_mini_cluster.cc:1428] Setting key 16f99600845503eab92fab28dd38428e
I20260809 15:41:11.071273 26619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:11.077567 26619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Bootstrap starting.
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:11.080191 26619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:11.081127 26619 log.cc:824] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:11.083096 26619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: No bootstrap required, opened a new log
I20260809 15:41:11.085127 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.072160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50266 (local address 127.14.15.190:42553)
0809 15:41:11.072634 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:11.072650 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:11.072687 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:41:11.073364 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:11.073380 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:11.073730 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:11.074075 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:11.074945 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.075931 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.076780 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.077249 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.077431 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.080219 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:11.080225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:11.080243 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:11.080277 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:11.082198 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.082726 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.082734 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.082745 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.082861 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.083153 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.083157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.083158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.083606 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:11.083806 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:11.084125 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 15:41:11.084423 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":167,"threads_started":1}
I20260809 15:41:11.086922 26619 raft_consensus.cc:348] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:11.087217 26619 raft_consensus.cc:374] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:11.087301 26619 raft_consensus.cc:729] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a38dcc5963884c018e1937ef98c920ae, State: Initialized, Role: FOLLOWER
I20260809 15:41:11.087728 26619 consensus_queue.cc:260] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:11.087850 26619 raft_consensus.cc:388] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:11.087898 26619 raft_consensus.cc:482] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:11.087976 26619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:11.088793 26619 raft_consensus.cc:504] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:11.089089 26619 leader_election.cc:302] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a38dcc5963884c018e1937ef98c920ae; no voters:
I20260809 15:41:11.089339 26619 leader_election.cc:288] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:41:11.089490 26625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:11.089849 26625 raft_consensus.cc:686] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 LEADER]: Becoming Leader. State: Replica: a38dcc5963884c018e1937ef98c920ae, State: Running, Role: LEADER
I20260809 15:41:11.090193 26625 consensus_queue.cc:237] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:11.090663 26619 sys_catalog.cc:564] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:11.091972 26626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a38dcc5963884c018e1937ef98c920ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } } }
I20260809 15:41:11.092129 26626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:11.092470 26628 sys_catalog.cc:455] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader a38dcc5963884c018e1937ef98c920ae. Latest consensus state: current_term: 1 leader_uuid: "a38dcc5963884c018e1937ef98c920ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } } }
I20260809 15:41:11.092569 26628 sys_catalog.cc:458] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:11.092555 26638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:11.096341 26638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:11.102438 26638 catalog_manager.cc:1347] Generated new cluster ID: be8827710b9141eba53559f983e52104
I20260809 15:41:11.102514 26638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:11.111220 26638 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:41:11.112094 26638 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:11.121459 26638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Generated new TSK 0
I20260809 15:41:11.122150 26638 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:41:11.159413 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:11.277978 26653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:11.278295 26653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:11.278342 26653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:11.282557 26653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:11.282619 26653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:11.282680 26653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:11.288141 26653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:11.289295 26653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:11.290439 26653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:11.300813 26669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.300813 26662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.300817 26663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:11.300880 26653 server_base.cc:1034] running on GCE node
I20260809 15:41:11.301548 26653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:11.302201 26653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:11.303438 26653 hybrid_clock.cc:648] HybridClock initialized: now 1786290071303405 us; error 42 us; skew 500 ppm
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:11.306340 26653 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:41:11.307271 26653 webserver.cc:460] Webserver started at http://127.14.15.129:40561/ using document root <none> and password file <none>
I20260809 15:41:11.307852 26653 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:11.307958 26653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:11.308194 26653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:11.310321 26653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "01b69d2ad75849e5a94016cc0c5ae044"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "39965981061831d927047d20414d6ea1"
server_key_iv: "c718770ad24819a197421954c804e772"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.311089 26653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "01b69d2ad75849e5a94016cc0c5ae044"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "39965981061831d927047d20414d6ea1"
server_key_iv: "c718770ad24819a197421954c804e772"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.315197 26653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 15:41:11.317788 26679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.319121 26653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:41:11.319260 26653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "01b69d2ad75849e5a94016cc0c5ae044"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "39965981061831d927047d20414d6ea1"
server_key_iv: "c718770ad24819a197421954c804e772"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.319394 26653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:11.335036 26653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:11.337988 26653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:11.338202 26653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:11.338853 26653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:11.339705 26653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:11.339780 26653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.339851 26653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:11.339895 26653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.349684 26653 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:34475
I20260809 15:41:11.349704 26860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:34475 every 8 connection(s)
I20260809 15:41:11.350687 26653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:11.357478 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 26653
I20260809 15:41:11.357620 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:41:11.357935 14398 external_mini_cluster.cc:1428] Setting key 13bc73ab2c321bf30d2e570a6b67448b
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:11.365067 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.352539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41645 (local address 127.14.15.190:42553)
0809 15:41:11.352693 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:11.352696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:11.353738 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 15:41:11.354704 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:11.354708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:11.354771 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:11.354881 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:11.356066 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.356646 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.358145 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.358491 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.358620 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.361477 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:11.361481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:11.361483 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:11.361516 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:11.362968 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.363495 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.363499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.363501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.363589 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.363930 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.363935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.363936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.364130 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:11.364241 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:11.364752 (+ 511us) server_negotiation.cc:299] Negotiation successful
0809 15:41:11.364885 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:41:11.365854 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.352892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:41645)
0809 15:41:11.353581 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:11.353624 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:11.354488 (+ 864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:11.355058 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:11.355065 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:11.355430 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:11.355913 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.355926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.356781 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.356786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.358015 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.358028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.358688 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.358692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.358894 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.359618 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:11.359641 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:11.361308 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:11.363106 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.363112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.363128 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.363390 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.363685 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.363689 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.363691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.363833 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.364241 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:11.364250 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:11.364516 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 15:41:11.364709 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:41:11.365037 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":123,"threads_started":1}
I20260809 15:41:11.367353 26861 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42553
I20260809 15:41:11.367616 26861 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:11.368129 26861 heartbeater.cc:511] Master 127.14.15.190:42553 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:41:11.369681 26572 ts_manager.cc:194] Registered new tserver with Master: 01b69d2ad75849e5a94016cc0c5ae044 (127.14.15.129:34475)
I20260809 15:41:11.370966 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:41645
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:41:11.389601 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:11.505136 26870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:11.505367 26870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:11.505407 26870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:11.509442 26870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:11.509496 26870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:11.509552 26870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:11.514639 26870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:11.515560 26870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:11.516572 26870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:11.526413 26877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.526503 26878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.526413 26880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:11.526640 26870 server_base.cc:1034] running on GCE node
I20260809 15:41:11.527098 26870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:11.527724 26870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:11.528911 26870 hybrid_clock.cc:648] HybridClock initialized: now 1786290071528889 us; error 32 us; skew 500 ppm
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:11.531629 26870 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:41:11.532470 26870 webserver.cc:460] Webserver started at http://127.14.15.130:37617/ using document root <none> and password file <none>
I20260809 15:41:11.532984 26870 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:11.533053 26870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:11.533219 26870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:11.535326 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "d1f242425158456ba4341904dbd74c21"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "a3a072be38aac9470a103c810caf78d1"
server_key_iv: "d8745b13d2a39abe53075c84ff55959b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.535848 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "d1f242425158456ba4341904dbd74c21"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "a3a072be38aac9470a103c810caf78d1"
server_key_iv: "d8745b13d2a39abe53075c84ff55959b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.539563 26870 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:41:11.542042 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.543294 26870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:11.543429 26870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "d1f242425158456ba4341904dbd74c21"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "a3a072be38aac9470a103c810caf78d1"
server_key_iv: "d8745b13d2a39abe53075c84ff55959b"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.543540 26870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:11.559613 26870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:11.563102 26870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:11.563316 26870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:11.563941 26870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:11.564810 26870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:11.564860 26870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.564930 26870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:11.564966 26870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.573917 26870 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44927
I20260809 15:41:11.573939 27054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44927 every 8 connection(s)
I20260809 15:41:11.574878 26870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:11.577214 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 26870
I20260809 15:41:11.577337 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:41:11.577631 14398 external_mini_cluster.cc:1428] Setting key 898a58941280e36d203a16ab268552fb
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:41:11.589287 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.576707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53565 (local address 127.14.15.190:42553)
0809 15:41:11.576884 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:11.576889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:11.577977 (+ 1088us) server_negotiation.cc:407] Connection header received
0809 15:41:11.578949 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:11.578952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:11.579005 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:11.579128 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:11.580308 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.580827 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.582086 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.582400 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.582523 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.585372 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:11.585376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:11.585378 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:11.585403 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:11.586905 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.587553 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.587555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.587557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.587637 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.588064 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.588067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.588068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.588254 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:11.588334 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:11.589033 (+ 699us) server_negotiation.cc:299] Negotiation successful
0809 15:41:11.589149 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:41:11.590173 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.577096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:53565)
0809 15:41:11.577825 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:11.577877 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:11.578748 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:11.579303 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:11.579309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:11.579692 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:11.580164 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.580177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.580998 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.581004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.581936 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.581947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.582555 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.582559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.582735 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.583351 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:11.583368 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:11.585169 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:11.587036 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.587045 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.587064 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.587439 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.587738 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.587745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.587750 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.587955 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.588371 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:11.588379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:11.588727 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 15:41:11.588970 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 15:41:11.589282 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":143,"threads_started":1}
I20260809 15:41:11.591609 27056 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:41:11.591902 27056 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:11.592623 27056 heartbeater.cc:511] Master 127.14.15.190:42553 requested a full tablet report, sending...
I20260809 15:41:11.593936 26572 ts_manager.cc:194] Registered new tserver with Master: d1f242425158456ba4341904dbd74c21 (127.14.15.130:44927)
I20260809 15:41:11.594640 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:53565
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:41:11.609864 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:11.729010 27062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:11.729290 27062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:11.729336 27062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:11.733400 27062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:11.733475 27062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:11.733541 27062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:11.739069 27062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:11.740201 27062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:11.741227 27062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:11.751492 27068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.751451 27072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:11.751451 27070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:11.751749 27062 server_base.cc:1034] running on GCE node
I20260809 15:41:11.752218 27062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:11.752923 27062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:11.754141 27062 hybrid_clock.cc:648] HybridClock initialized: now 1786290071754106 us; error 47 us; skew 500 ppm
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:11.757192 27062 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:41:11.758147 27062 webserver.cc:460] Webserver started at http://127.14.15.131:32855/ using document root <none> and password file <none>
I20260809 15:41:11.758756 27062 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:11.758852 27062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:11.759107 27062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:11.761258 27062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "1350ab1e7e984233b8dfbd0b1a188c07"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "40df859cc7af0ae89b546955dc326a08"
server_key_iv: "3354f40098248c4a9c5828f26bebe5f0"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.761857 27062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "1350ab1e7e984233b8dfbd0b1a188c07"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "40df859cc7af0ae89b546955dc326a08"
server_key_iv: "3354f40098248c4a9c5828f26bebe5f0"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.765817 27062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:41:11.768584 27080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.769809 27062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:41:11.769953 27062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "1350ab1e7e984233b8dfbd0b1a188c07"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "40df859cc7af0ae89b546955dc326a08"
server_key_iv: "3354f40098248c4a9c5828f26bebe5f0"
server_key_version: "encryptionkey@0"
I20260809 15:41:11.770093 27062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:11.787292 27062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:11.790416 27062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:11.790655 27062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:11.791373 27062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:11.792303 27062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:11.792382 27062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.792457 27062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:11.792490 27062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:11.801723 27062 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:35913
I20260809 15:41:11.801738 27265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:35913 every 8 connection(s)
I20260809 15:41:11.802704 27062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:11.808185 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 27062
I20260809 15:41:11.808372 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:41:11.808727 14398 external_mini_cluster.cc:1428] Setting key 6af5afb6ed8520c2b17e437ff6184022
Aug 09 15:41:11 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290071, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:11.816768 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.804542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:37033 (local address 127.14.15.190:42553)
0809 15:41:11.804683 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:11.804687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:11.805668 (+ 981us) server_negotiation.cc:407] Connection header received
0809 15:41:11.806697 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:11.806701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:11.806765 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:11.806871 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:11.808070 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.808696 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.810073 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.810436 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.810557 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.813321 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:11.813326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:11.813329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:11.813363 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:11.814758 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.815266 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.815269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.815271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.815358 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:11.815720 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:11.815722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:11.815724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:11.815912 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:11.816001 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:11.816509 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 15:41:11.816637 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:41:11.817581 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:11.804832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:37033)
0809 15:41:11.805510 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:11.805552 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:11.806469 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:11.807050 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:11.807057 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:11.807421 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:11.807918 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.807932 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.808828 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.808831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.809937 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:11.809947 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:11.810617 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:11.810622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:11.810801 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:11.811502 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:11.811562 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:11.813148 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:11.814874 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.814879 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.814893 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.815156 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.815465 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:11.815468 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:11.815470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:11.815629 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:11.816015 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:11.816021 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:11.816268 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 15:41:11.816430 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 15:41:11.816710 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":123,"threads_started":1}
I20260809 15:41:11.818841 27266 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42553
I20260809 15:41:11.819110 27266 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:11.819650 27266 heartbeater.cc:511] Master 127.14.15.190:42553 requested a full tablet report, sending...
I20260809 15:41:11.820773 26572 ts_manager.cc:194] Registered new tserver with Master: 1350ab1e7e984233b8dfbd0b1a188c07 (127.14.15.131:35913)
I20260809 15:41:11.821369 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:37033
I20260809 15:41:11.823203 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
Entry for principal oryx/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab.
WARNING: no policy specified for oryx/127.14.15.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
Entry for principal oryx/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab.
WARNING: no policy specified for oryx/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
Entry for principal oryx/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab.
I20260809 15:41:11.905440 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 26653
I20260809 15:41:11.916774 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 26870
I20260809 15:41:11.936137 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 27062
I20260809 15:41:11.949568 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 26514
I20260809 15:41:11.965197 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42553
--webserver_interface=127.14.15.190
--webserver_port=44649
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:12.081141 27280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:12.081427 27280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:12.081468 27280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:12.085472 27280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:12.085536 27280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:12.085556 27280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:12.085573 27280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:12.085589 27280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:12.090916 27280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:42553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=44649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:12.092029 27280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:12.093026 27280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:12.101944 27285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:12.102043 27290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.102085 27280 server_base.cc:1034] running on GCE node
W20260809 15:41:12.101944 27287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.102895 27280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:12.103960 27280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:12.105132 27280 hybrid_clock.cc:648] HybridClock initialized: now 1786290072105114 us; error 33 us; skew 500 ppm
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:12.107890 27280 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:41:12.108812 27280 webserver.cc:460] Webserver started at http://127.14.15.190:44649/ using document root <none> and password file <none>
I20260809 15:41:12.109339 27280 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:12.109414 27280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:12.113299 27280 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:41:12.115446 27300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.116663 27280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:12.116766 27280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "a38dcc5963884c018e1937ef98c920ae"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "3cd3bc2aae7f29c093058102f71268a4"
server_key_iv: "4f1420d44810f35fafb9ab358de2936b"
server_key_version: "encryptionkey@0"
I20260809 15:41:12.117288 27280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:12.145920 27280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:12.149030 27280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:12.149199 27280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:12.157142 27280 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:42553
I20260809 15:41:12.157172 27373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:42553 every 8 connection(s)
I20260809 15:41:12.158305 27280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:12.162626 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 27280
I20260809 15:41:12.162955 27376 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:41:12.163169 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:34475
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:42553
--webserver_port=40561
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:41:12.165445 27376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Bootstrap starting.
I20260809 15:41:12.182408 27376 log.cc:824] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:12.189301 27376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:41:12.189714 27376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Bootstrap complete.
I20260809 15:41:12.194031 27376 raft_consensus.cc:348] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:12.194550 27376 raft_consensus.cc:729] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a38dcc5963884c018e1937ef98c920ae, State: Initialized, Role: FOLLOWER
I20260809 15:41:12.195123 27376 consensus_queue.cc:260] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:12.195250 27376 raft_consensus.cc:388] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:12.195339 27376 raft_consensus.cc:482] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:12.195492 27376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:41:12.197503 27376 raft_consensus.cc:504] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:12.197853 27376 leader_election.cc:302] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a38dcc5963884c018e1937ef98c920ae; no voters:
I20260809 15:41:12.198246 27376 leader_election.cc:288] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:41:12.198380 27382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:41:12.198647 27382 raft_consensus.cc:686] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [term 2 LEADER]: Becoming Leader. State: Replica: a38dcc5963884c018e1937ef98c920ae, State: Running, Role: LEADER
I20260809 15:41:12.199007 27382 consensus_queue.cc:237] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } }
I20260809 15:41:12.199610 27376 sys_catalog.cc:564] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:12.200052 27382 sys_catalog.cc:455] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader a38dcc5963884c018e1937ef98c920ae. Latest consensus state: current_term: 2 leader_uuid: "a38dcc5963884c018e1937ef98c920ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } } }
I20260809 15:41:12.200181 27382 sys_catalog.cc:458] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:12.200456 27383 sys_catalog.cc:455] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a38dcc5963884c018e1937ef98c920ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a38dcc5963884c018e1937ef98c920ae" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42553 } } }
I20260809 15:41:12.200567 27383 sys_catalog.cc:458] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:12.201912 27386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:12.205281 27386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:12.205950 27386 catalog_manager.cc:1259] Loaded cluster ID: be8827710b9141eba53559f983e52104
I20260809 15:41:12.206023 27386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:12.208395 27386 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:12.209076 27386 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a38dcc5963884c018e1937ef98c920ae: Loaded TSK: 0
I20260809 15:41:12.210436 27386 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:41:12.286374 27380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:12.286772 27380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:12.286857 27380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:12.291623 27380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:12.291706 27380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:12.291797 27380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:12.297158 27380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.129.keytab
--principal=oryx/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:34475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=40561
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:12.298384 27380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:12.299403 27380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:12.309543 27411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:12.309531 27412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.309593 27380 server_base.cc:1034] running on GCE node
W20260809 15:41:12.309540 27414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.310302 27380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:12.311105 27380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:12.312317 27380 hybrid_clock.cc:648] HybridClock initialized: now 1786290072312285 us; error 47 us; skew 500 ppm
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290072, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:12.315857 27380 init.cc:377] Logged in from keytab as oryx/127.14.15.129@KRBTEST.COM (short username oryx)
I20260809 15:41:12.317138 27380 webserver.cc:460] Webserver started at http://127.14.15.129:40561/ using document root <none> and password file <none>
I20260809 15:41:12.317888 27380 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:12.318004 27380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:12.323362 27380 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:41:12.325960 27423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.327543 27380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:12.327668 27380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "01b69d2ad75849e5a94016cc0c5ae044"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "39965981061831d927047d20414d6ea1"
server_key_iv: "c718770ad24819a197421954c804e772"
server_key_version: "encryptionkey@0"
I20260809 15:41:12.328377 27380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:12.342993 27380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:12.346800 27380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:12.347036 27380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:12.347769 27380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:12.348810 27380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:12.348874 27380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.348927 27380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:12.348958 27380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.360095 27380 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:34475
I20260809 15:41:12.360140 27587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:34475 every 8 connection(s)
I20260809 15:41:12.361344 27380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:12.371222 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 27380
I20260809 15:41:12.371790 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:44927
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:42553
--webserver_port=37617
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:41:12.374645 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.363614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:54027 (local address 127.14.15.190:42553)
0809 15:41:12.364125 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.364144 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.364726 (+ 582us) server_negotiation.cc:407] Connection header received
0809 15:41:12.365747 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.365762 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.366113 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.366519 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.367522 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.368457 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.369554 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.369990 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.370108 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.373895 (+ 3787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:54027: BlockingRecv error: recv got EOF from 127.14.15.129:54027 (error 108)
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":130,"threads_started":1}
I20260809 15:41:12.374651 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.363677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:54027)
0809 15:41:12.364541 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.364595 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.365350 (+ 755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.366562 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.366568 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.366914 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.367371 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.367384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.368585 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.368588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.369429 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.369446 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.370128 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.370130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.370330 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.370993 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.371017 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.373699 (+ 2682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":128,"threads_started":1}
W20260809 15:41:12.375411 27590 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:42553 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.15.190:42553: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.380877 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.375855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:47069)
0809 15:41:12.375965 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.375982 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.376058 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.376293 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.376296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.376458 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.376546 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.376551 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.377257 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.377263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.377794 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.377802 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.378270 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.378273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.378367 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.378881 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.378893 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.380694 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:41:12.380882 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.375950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:47069 (local address 127.14.15.190:42553)
0809 15:41:12.376058 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.376063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.376077 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:12.376140 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.376143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.376195 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.376279 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.376657 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.377150 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.377920 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.378132 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.378262 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.380797 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:47069: BlockingRecv error: recv got EOF from 127.14.15.129:47069 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.387029 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.381508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:49509)
0809 15:41:12.381695 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.381713 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.381810 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.382051 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.382056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.382255 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.382374 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.382383 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.383085 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.383092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.384065 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.384081 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.384500 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.384503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.384591 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.385034 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.385048 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.386882 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108}
W20260809 15:41:12.387118 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.381612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:49509 (local address 127.14.15.190:42553)
0809 15:41:12.381721 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.381724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.381761 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:41:12.381898 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.381899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.381935 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.382003 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.382490 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.382974 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.384190 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.384388 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.384460 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.386994 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:49509: BlockingRecv error: recv got EOF from 127.14.15.129:49509 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:41:12.387326 27590 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:41:12.490067 27595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:12.490403 27595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:12.490487 27595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:12.494483 27595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:12.494572 27595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:12.494663 27595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:12.500075 27595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.130.keytab
--principal=oryx/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:44927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=37617
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:12.501214 27595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:12.502267 27595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:12.512135 27603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.512225 27595 server_base.cc:1034] running on GCE node
W20260809 15:41:12.512244 27604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:12.512146 27607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.512899 27595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:12.513540 27595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:12.514725 27595 hybrid_clock.cc:648] HybridClock initialized: now 1786290072514710 us; error 26 us; skew 500 ppm
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290072, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:12.517418 27595 init.cc:377] Logged in from keytab as oryx/127.14.15.130@KRBTEST.COM (short username oryx)
I20260809 15:41:12.518349 27595 webserver.cc:460] Webserver started at http://127.14.15.130:37617/ using document root <none> and password file <none>
I20260809 15:41:12.518890 27595 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:12.518967 27595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:12.523108 27595 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 15:41:12.525128 27619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.526440 27595 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:12.526563 27595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "d1f242425158456ba4341904dbd74c21"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "a3a072be38aac9470a103c810caf78d1"
server_key_iv: "d8745b13d2a39abe53075c84ff55959b"
server_key_version: "encryptionkey@0"
I20260809 15:41:12.527097 27595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:12.539312 27595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:12.542560 27595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:12.542768 27595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:12.543378 27595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:12.544255 27595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:12.544302 27595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.544369 27595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:12.544410 27595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.553416 27595 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44927
I20260809 15:41:12.553442 27781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44927 every 8 connection(s)
I20260809 15:41:12.554553 27595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:12.559855 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 27595
I20260809 15:41:12.560359 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:35913
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:42553
--webserver_port=32855
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:41:12.567373 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.556348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:39815 (local address 127.14.15.190:42553)
0809 15:41:12.556521 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.556526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.557549 (+ 1023us) server_negotiation.cc:407] Connection header received
0809 15:41:12.558451 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.558454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.558509 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.558589 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.560143 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.560782 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.562571 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.562960 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.563097 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.567260 (+ 4163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:39815: BlockingRecv error: recv got EOF from 127.14.15.130:39815 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:41:12.568341 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.556731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:39815)
0809 15:41:12.557393 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.557434 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.558202 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.558758 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.558765 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.559280 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.559966 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.559999 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.560921 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.560927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.562443 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.562454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.563130 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.563132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.563274 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.563931 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.563958 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.567119 (+ 3161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":117,"threads_started":1}
W20260809 15:41:12.568930 27782 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:42553 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.15.190:42553: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.574940 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.569414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:54837)
0809 15:41:12.569651 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.569666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.569767 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.570051 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.570054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.570285 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.570397 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.570403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.571162 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.571167 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.571725 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.571733 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.572203 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.572207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.572299 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.572875 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.572887 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.574805 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131}
W20260809 15:41:12.575114 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.569571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:54837 (local address 127.14.15.190:42553)
0809 15:41:12.569691 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.569698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.569714 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:41:12.569876 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.569879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.569942 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.570032 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.570524 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.571045 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.571857 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.572084 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.572199 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.574971 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:54837: BlockingRecv error: recv got EOF from 127.14.15.130:54837 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.581233 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.575695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:49451)
0809 15:41:12.575862 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.575875 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.575942 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.576152 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.576154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.576313 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.576409 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.576415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.577128 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.577131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.577991 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.578000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.578542 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.578545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.578633 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.579085 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.579100 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.581099 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102}
W20260809 15:41:12.581326 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.575796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:49451 (local address 127.14.15.190:42553)
0809 15:41:12.575912 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.575915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.575933 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:41:12.576040 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.576042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.576082 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.576132 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.576512 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.577023 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.578136 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.578430 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.578523 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.581236 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:49451: BlockingRecv error: recv got EOF from 127.14.15.130:49451 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:41:12.581805 27782 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:41:12.683668 27789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:12.683982 27789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:12.684059 27789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:12.688160 27789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:12.688251 27789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:12.688344 27789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:12.693661 27789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/krb5kdc/oryx_127.14.15.131.keytab
--principal=oryx/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:35913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=32855
--tserver_master_addrs=127.14.15.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:12.694900 27789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:12.695960 27789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:41:12.706182 27789 server_base.cc:1034] running on GCE node
W20260809 15:41:12.706279 27798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:12.706140 27799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:12.706146 27804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:12.706946 27789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:12.707564 27789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:12.708737 27789 hybrid_clock.cc:648] HybridClock initialized: now 1786290072708720 us; error 26 us; skew 500 ppm
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290072, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:12.711719 27789 init.cc:377] Logged in from keytab as oryx/127.14.15.131@KRBTEST.COM (short username oryx)
I20260809 15:41:12.712600 27789 webserver.cc:460] Webserver started at http://127.14.15.131:32855/ using document root <none> and password file <none>
I20260809 15:41:12.713121 27789 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:12.713192 27789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:12.717124 27789 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:41:12.719316 27814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.720645 27789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:12.720794 27789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "1350ab1e7e984233b8dfbd0b1a188c07"
format_stamp: "Formatted at 2026-08-09 15:41:11 on dist-test-slave-jztv"
server_key: "40df859cc7af0ae89b546955dc326a08"
server_key_iv: "3354f40098248c4a9c5828f26bebe5f0"
server_key_version: "encryptionkey@0"
I20260809 15:41:12.721365 27789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:12.741844 27789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:12.745039 27789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:12.745273 27789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:12.745921 27789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:12.746824 27789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:12.746901 27789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.746977 27789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:12.747021 27789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:12.756616 27789 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:35913
I20260809 15:41:12.756639 27971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:35913 every 8 connection(s)
I20260809 15:41:12.757680 27789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:12.759464 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 27789
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:41:12.769248 27592 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.760565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:60261 (local address 127.14.15.190:42553)
0809 15:41:12.760696 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.760701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.761338 (+ 637us) server_negotiation.cc:407] Connection header received
0809 15:41:12.762207 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.762234 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.762290 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.762369 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.763520 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.764023 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.765319 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.765537 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.765648 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.769121 (+ 3473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:60261: BlockingRecv error: recv got EOF from 127.14.15.131:60261 (error 108)
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":53}
I20260809 15:41:12.769778 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.761022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.14.15.190:42553)
0809 15:41:12.761290 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.761293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.761325 (+ 32us) server_negotiation.cc:407] Connection header received
0809 15:41:12.761379 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.761382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.761435 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.761538 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.762367 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.762938 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.763847 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.764098 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.764214 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.765680 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:12.765686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:12.765699 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:12.765728 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:12.767603 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:12.768061 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:12.768066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:12.768070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:12.768186 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:12.768539 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:12.768545 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:12.768551 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:12.768890 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:12.769118 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:12.769404 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 15:41:12.769649 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":193,"thread_start_us":119,"threads_started":1}
I20260809 15:41:12.769963 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.760143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:60261)
0809 15:41:12.761203 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.761244 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.762000 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.762562 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.762569 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.762910 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.763367 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.763380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.764151 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.764154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.765191 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.765202 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.765687 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.765691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.765855 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.766529 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.766552 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.769022 (+ 2470us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":158,"threads_started":1}
W20260809 15:41:12.770450 27972 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:42553 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.15.190:42553: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.775851 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.770890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:47989)
0809 15:41:12.771127 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.771140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.771212 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.771405 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.771408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.771593 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.771719 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.771726 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.772653 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.772659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.773209 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.773218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.773642 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.773645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.773717 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.774133 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.774144 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.775759 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172}
W20260809 15:41:12.776038 27978 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.771119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:47989 (local address 127.14.15.190:42553)
0809 15:41:12.771232 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.771235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.771246 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:41:12.771276 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.771278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.771308 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.771370 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.771833 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.772526 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.773308 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.773525 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.773603 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.775909 (+ 2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:47989: BlockingRecv error: recv got EOF from 127.14.15.131:47989 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:12 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:12.780701 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:12.776365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:56385)
0809 15:41:12.776509 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:12.776522 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:12.776583 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:12.776789 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:12.776791 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:12.776909 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:12.776975 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.776979 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.777601 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.777603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.778093 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:12.778100 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.778527 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.778530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:12.778586 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.779025 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:12.779037 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:12.780615 (+ 1578us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 15:41:12.780825 27978 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:12.776470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:56385 (local address 127.14.15.190:42553)
0809 15:41:12.776621 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:12.776624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:12.776636 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:41:12.776664 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:12.776666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:12.776697 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:12.776759 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:12.777071 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.777513 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.778190 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:12.778432 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:12.778507 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:12.780723 (+ 2216us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:56385: BlockingRecv error: recv got EOF from 127.14.15.131:56385 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 15:41:12.780917 27972 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:13.393750 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:13.388092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:57789)
0809 15:41:13.388371 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:13.388386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:13.388483 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:13.388841 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:13.388843 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:13.389033 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:13.389135 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.389141 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.389928 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.389931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.390569 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.390585 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.391034 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.391037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.391103 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.391640 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:13.391653 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:13.393617 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
W20260809 15:41:13.394004 27980 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:13.388153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:57789 (local address 127.14.15.190:42553)
0809 15:41:13.388423 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:13.388427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:13.388442 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:41:13.388665 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:13.388667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:13.388715 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:13.388801 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:13.389253 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.389817 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.390694 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.390932 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.391015 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.393835 (+ 2820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:57789: BlockingRecv error: recv got EOF from 127.14.15.129:57789 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":110,"threads_started":1}
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:13.588322 27981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:13.582439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:57087)
0809 15:41:13.582782 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:13.582799 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:13.582956 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:13.583257 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:13.583260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:13.583487 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:13.583608 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.583614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.584381 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.584387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.584960 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.584969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.585438 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.585441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.585521 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.586038 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:13.586049 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:13.588200 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":89,"threads_started":1}
W20260809 15:41:13.588449 27980 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:13.582591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:57087 (local address 127.14.15.190:42553)
0809 15:41:13.582774 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:13.582778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:13.582894 (+ 116us) server_negotiation.cc:407] Connection header received
0809 15:41:13.583076 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:13.583081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:13.583138 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:13.583230 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:13.583740 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.584263 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.585096 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.585321 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.585433 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.588330 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:57087: BlockingRecv error: recv got EOF from 127.14.15.130:57087 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:13 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:13.786964 27983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:13.781603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:57445)
0809 15:41:13.781879 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:13.781892 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:13.781992 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:13.782303 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:13.782305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:13.782490 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:13.782589 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.782594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.783307 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.783310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.783861 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:13.783868 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.784273 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.784275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:13.784334 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.784833 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:13.784845 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:13.786837 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
W20260809 15:41:13.787091 27980 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:13.781677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:57445 (local address 127.14.15.190:42553)
0809 15:41:13.781818 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:13.781822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:13.781945 (+ 123us) server_negotiation.cc:407] Connection header received
0809 15:41:13.782087 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:13.782090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:13.782145 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:13.782231 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:13.782692 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.783214 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.783961 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:13.784178 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:13.784253 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:13.786967 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:57445: BlockingRecv error: recv got EOF from 127.14.15.131:57445 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:14.400333 27986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:14.394694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:52309)
0809 15:41:14.394996 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:14.395009 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:14.395101 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:14.395327 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:14.395329 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:14.395515 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:14.395611 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.395616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.396356 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.396359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.396932 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.396942 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.397376 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.397379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.397458 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.397952 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:14.397964 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:14.400134 (+ 2170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":117,"threads_started":1}
W20260809 15:41:14.400364 27987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:14.394765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:52309 (local address 127.14.15.190:42553)
0809 15:41:14.395073 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:14.395077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:14.395102 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:41:14.395189 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:14.395191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:14.395235 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:14.395318 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:14.395712 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.396232 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.397053 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.397277 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.397357 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.400242 (+ 2885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:52309: BlockingRecv error: recv got EOF from 127.14.15.129:52309 (error 108)
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":99,"threads_started":1}
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:14.595427 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:14.589209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:42521)
0809 15:41:14.589539 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:14.589558 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:14.589827 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:14.590131 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:14.590134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:14.590392 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:14.590520 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.590527 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.591320 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.591326 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.591892 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.591901 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.592379 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.592382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.592481 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.593065 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:14.593078 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:14.595273 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
W20260809 15:41:14.595624 27987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:14.589297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:42521 (local address 127.14.15.190:42553)
0809 15:41:14.589522 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:14.589527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:14.589763 (+ 236us) server_negotiation.cc:407] Connection header received
0809 15:41:14.589949 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:14.589952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:14.590006 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:14.590103 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:14.590651 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.591198 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.592024 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.592254 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.592372 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.595468 (+ 3096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:42521: BlockingRecv error: recv got EOF from 127.14.15.130:42521 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:14 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:14.794328 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:14.787952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:58101)
0809 15:41:14.788391 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:14.788406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:14.788510 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:14.788788 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:14.788791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:14.789001 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:14.789109 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.789115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.789994 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.790001 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.790906 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:14.790916 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.791408 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.791412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:14.791483 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.792095 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:14.792110 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:14.794121 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":77,"threads_started":1}
W20260809 15:41:14.794538 27987 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:14.788262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:58101 (local address 127.14.15.190:42553)
0809 15:41:14.788413 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:14.788417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:14.788463 (+ 46us) server_negotiation.cc:407] Connection header received
0809 15:41:14.788593 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:14.788596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:14.788643 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:14.788706 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:14.789265 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.789853 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.791048 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:14.791273 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:14.791374 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:14.794395 (+ 3021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:58101: BlockingRecv error: recv got EOF from 127.14.15.131:58101 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:15.406857 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:15.401177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:34725)
0809 15:41:15.401508 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:15.401532 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:15.401635 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:15.401915 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:15.401917 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:15.402150 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:15.402324 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.402331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.403118 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.403121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.403674 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.403683 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.404142 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.404145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.404205 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.404712 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:15.404725 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:15.406739 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":138,"threads_started":1}
W20260809 15:41:15.407024 27994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:15.401288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:34725 (local address 127.14.15.190:42553)
0809 15:41:15.401543 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:15.401547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:15.401592 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:41:15.401746 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:15.401748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:15.401793 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:15.401877 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:15.402434 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.403013 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.403808 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.404036 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.404127 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.406883 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:34725: BlockingRecv error: recv got EOF from 127.14.15.129:34725 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":92,"threads_started":1}
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:15.602715 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:15.596534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:39863)
0809 15:41:15.596911 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:15.596925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:15.597074 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:15.597428 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:15.597431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:15.597685 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:15.597812 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.597819 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.598654 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.598657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.599253 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.599263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.599745 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.599752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.599841 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.600395 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:15.600410 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:15.602496 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
W20260809 15:41:15.602754 27994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:15.596650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:39863 (local address 127.14.15.190:42553)
0809 15:41:15.596803 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:15.596807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:15.597018 (+ 211us) server_negotiation.cc:407] Connection header received
0809 15:41:15.597180 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:15.597184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:15.597270 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:15.597355 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:15.597962 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.598520 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.599390 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.599629 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.599780 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.602658 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:39863: BlockingRecv error: recv got EOF from 127.14.15.130:39863 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:15 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:15.801357 27997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:15.795291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:35789)
0809 15:41:15.795613 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:15.795625 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:15.795726 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:15.796146 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:15.796149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:15.796349 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:15.796448 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.796453 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.797207 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.797211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.797788 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:15.797797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.798507 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.798510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:15.798599 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.799140 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:15.799152 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:15.801233 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":91,"threads_started":1}
W20260809 15:41:15.801570 27994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:15.795403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:35789 (local address 127.14.15.190:42553)
0809 15:41:15.795565 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:15.795570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:15.795858 (+ 288us) server_negotiation.cc:407] Connection header received
0809 15:41:15.795907 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:15.795910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:15.795986 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:15.796071 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:15.796559 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.797083 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.797933 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:15.798173 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:15.798331 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:15.801421 (+ 3090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:35789: BlockingRecv error: recv got EOF from 127.14.15.131:35789 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:16.416024 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:16.407721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:60681)
0809 15:41:16.408020 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:16.408034 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:16.408127 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:16.408379 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:16.408381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:16.408564 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:16.408660 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.408665 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.409370 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.409372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.409920 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.409927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.410348 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.410350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.410415 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.413887 (+ 3472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:16.413900 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:16.415895 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":74,"threads_started":1}
W20260809 15:41:16.416227 28000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:16.407786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:60681 (local address 127.14.15.190:42553)
0809 15:41:16.408078 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:16.408082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:16.408096 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:16.408219 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:16.408221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:16.408264 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:16.408352 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:16.408761 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.409280 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.410021 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.410254 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.410331 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.416046 (+ 5715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:60681: BlockingRecv error: recv got EOF from 127.14.15.129:60681 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":114,"threads_started":1}
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:16.609246 28001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:16.603619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:38833)
0809 15:41:16.603908 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:16.603929 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:16.604041 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:16.604343 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:16.604346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:16.604569 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:16.604680 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.604687 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.605464 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.605467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.606030 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.606042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.606487 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.606490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.606561 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.607055 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:16.607067 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:16.609083 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":107,"threads_started":1}
W20260809 15:41:16.609555 28000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:16.603745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:38833 (local address 127.14.15.190:42553)
0809 15:41:16.603896 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:16.603900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:16.604036 (+ 136us) server_negotiation.cc:407] Connection header received
0809 15:41:16.604143 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:16.604145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:16.604198 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:16.604265 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:16.604809 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.605336 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.606140 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.606376 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.606451 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.609269 (+ 2818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:38833: BlockingRecv error: recv got EOF from 127.14.15.130:38833 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:16 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:16.807476 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:16.802115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:55203)
0809 15:41:16.802401 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:16.802425 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:16.802558 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:16.802809 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:16.802811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:16.802998 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:16.803093 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.803098 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.803806 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.803808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.804360 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:16.804368 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.804776 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.804779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:16.804843 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.805342 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:16.805354 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:16.807352 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":126,"threads_started":1}
W20260809 15:41:16.807618 28000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:16.802203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:55203 (local address 127.14.15.190:42553)
0809 15:41:16.802403 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:16.802410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:16.802509 (+ 99us) server_negotiation.cc:407] Connection header received
0809 15:41:16.802655 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:16.802657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:16.802706 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:16.802772 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:16.803191 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.803707 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.804462 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:16.804668 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:16.804743 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:16.807497 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:55203: BlockingRecv error: recv got EOF from 127.14.15.131:55203 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:17.422744 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:17.416873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:57653)
0809 15:41:17.417232 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:17.417247 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:17.417351 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:17.417712 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:17.417714 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:17.417907 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:17.418024 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.418030 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.418853 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.418856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.419471 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.419481 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.419956 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.419959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.420029 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.420577 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:17.420597 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:17.422627 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":95,"threads_started":1}
W20260809 15:41:17.422947 28006 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:17.417019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:57653 (local address 127.14.15.190:42553)
0809 15:41:17.417271 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:17.417274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:17.417305 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:41:17.417484 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:17.417488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:17.417562 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:17.417654 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:17.418132 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.418746 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.419586 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.419812 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.419894 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.422802 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:57653: BlockingRecv error: recv got EOF from 127.14.15.129:57653 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":64,"threads_started":1}
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:17.615907 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:17.610102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:38485)
0809 15:41:17.610441 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:17.610458 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:17.610632 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:17.610920 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:17.610923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:17.611151 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:17.611244 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.611250 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.612015 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.612019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.612590 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.612599 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.613078 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.613082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.613171 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.613740 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:17.613753 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:17.615778 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":134,"threads_started":1}
W20260809 15:41:17.616056 28006 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:17.610309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:38485 (local address 127.14.15.190:42553)
0809 15:41:17.610475 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:17.610483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:17.610567 (+ 84us) server_negotiation.cc:407] Connection header received
0809 15:41:17.610739 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:17.610743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:17.610800 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:17.610895 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:17.611375 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.611900 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.612721 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.612952 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.613075 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.615926 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:38485: BlockingRecv error: recv got EOF from 127.14.15.130:38485 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:17 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:17.814416 28012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:17.808533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:39335)
0809 15:41:17.808838 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:17.808852 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:17.808988 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:17.809264 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:17.809266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:17.809460 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:17.809556 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.809561 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.810322 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.810325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.810918 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:17.810928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.811338 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.811341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:17.811405 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.811986 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:17.811998 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:17.814218 (+ 2220us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":110,"threads_started":1}
W20260809 15:41:17.814477 28006 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:17.808620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39335 (local address 127.14.15.190:42553)
0809 15:41:17.808785 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:17.808791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:17.808937 (+ 146us) server_negotiation.cc:407] Connection header received
0809 15:41:17.809085 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:17.809088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:17.809137 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:17.809200 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:17.809667 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.810191 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.811026 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:17.811240 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:17.811317 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:17.814367 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:39335: BlockingRecv error: recv got EOF from 127.14.15.131:39335 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:18.429309 28013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:18.423538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:41535)
0809 15:41:18.423841 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:18.423855 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:18.423962 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:18.424205 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:18.424207 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:18.424408 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:18.424511 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.424531 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.425479 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.425482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.426055 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.426064 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.426654 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.426657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.426726 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.427328 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:18.427341 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:18.429186 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":94,"threads_started":1}
W20260809 15:41:18.429523 28015 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:18.423605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41535 (local address 127.14.15.190:42553)
0809 15:41:18.423845 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:18.423849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:18.423930 (+ 81us) server_negotiation.cc:407] Connection header received
0809 15:41:18.424041 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:18.424043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:18.424090 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:18.424167 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:18.424689 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.425355 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.426201 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.426515 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.426621 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.429334 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:41535: BlockingRecv error: recv got EOF from 127.14.15.129:41535 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":63,"threads_started":1}
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:18.622859 28016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:18.616774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:59927)
0809 15:41:18.617114 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:18.617127 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:18.617269 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:18.617592 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:18.617595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:18.617810 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:18.617907 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.617914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.618766 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.618771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.619481 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.619492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.619966 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.619969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.620055 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.620624 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:18.620647 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:18.622683 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":83,"threads_started":1}
W20260809 15:41:18.622921 28015 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:18.616881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:59927 (local address 127.14.15.190:42553)
0809 15:41:18.617061 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:18.617065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:18.617208 (+ 143us) server_negotiation.cc:407] Connection header received
0809 15:41:18.617372 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:18.617376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:18.617432 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:18.617523 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:18.618045 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.618652 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.619611 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.619847 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.619960 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.622813 (+ 2853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:59927: BlockingRecv error: recv got EOF from 127.14.15.130:59927 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:18 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:18.820744 28017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:18.815288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:56931)
0809 15:41:18.815630 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:18.815644 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:18.815742 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:18.815975 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:18.815977 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:18.816176 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:18.816274 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.816279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.816979 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.816981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.817534 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:18.817541 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.817929 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.817932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:18.817991 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.818513 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:18.818526 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:18.820566 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":178,"threads_started":1}
W20260809 15:41:18.820801 28015 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:18.815365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:56931 (local address 127.14.15.190:42553)
0809 15:41:18.815533 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:18.815538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:18.815719 (+ 181us) server_negotiation.cc:407] Connection header received
0809 15:41:18.815810 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:18.815813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:18.815865 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:18.815938 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:18.816370 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.816880 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.817629 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:18.817836 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:18.817919 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:18.820690 (+ 2771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:56931: BlockingRecv error: recv got EOF from 127.14.15.131:56931 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:19.435906 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:19.430178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:48747)
0809 15:41:19.430592 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:19.430606 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:19.430712 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:19.430959 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:19.430961 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:19.431154 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:19.431305 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.431312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.432070 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.432073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.432638 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.432646 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.433068 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.433071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.433140 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.433768 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:19.433780 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:19.435784 (+ 2004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":100,"threads_started":1}
W20260809 15:41:19.436072 28023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:19.430310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:48747 (local address 127.14.15.190:42553)
0809 15:41:19.430612 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:19.430616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:19.430661 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:41:19.430796 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:19.430798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:19.430843 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:19.430920 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:19.431394 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.431973 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.432738 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.432959 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.433042 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.435924 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:48747: BlockingRecv error: recv got EOF from 127.14.15.129:48747 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":101,"threads_started":1}
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:19.629361 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:19.623674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:39937)
0809 15:41:19.624013 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:19.624034 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:19.624136 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:19.624441 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:19.624444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:19.624648 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:19.624745 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.624750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.625529 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.625536 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.626116 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.626125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.626567 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.626570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.626634 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.627211 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:19.627224 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:19.629181 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":110,"threads_started":1}
W20260809 15:41:19.629418 28023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:19.623748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:39937 (local address 127.14.15.190:42553)
0809 15:41:19.623906 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:19.623910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:19.624104 (+ 194us) server_negotiation.cc:407] Connection header received
0809 15:41:19.624216 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:19.624218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:19.624282 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:19.624353 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:19.624860 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.625396 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.626248 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.626466 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.626546 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.629309 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:39937: BlockingRecv error: recv got EOF from 127.14.15.130:39937 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:19 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:19.827558 28025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:19.821731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:58723)
0809 15:41:19.822076 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:19.822096 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:19.822264 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:19.822566 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:19.822568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:19.822776 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:19.822875 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.822880 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.823674 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.823677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.824235 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:19.824244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.824698 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.824700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:19.824761 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.825327 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:19.825340 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:19.827420 (+ 2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":107,"threads_started":1}
W20260809 15:41:19.827840 28023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:19.821840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:58723 (local address 127.14.15.190:42553)
0809 15:41:19.821989 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:19.821993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:19.822195 (+ 202us) server_negotiation.cc:407] Connection header received
0809 15:41:19.822356 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:19.822359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:19.822410 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:19.822512 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:19.822993 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.823553 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.824349 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:19.824594 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:19.824678 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:19.827604 (+ 2926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:58723: BlockingRecv error: recv got EOF from 127.14.15.131:58723 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:20.442365 28026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:20.436862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:54951)
0809 15:41:20.437178 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:20.437192 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:20.437285 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:20.437521 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:20.437523 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:20.437717 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:20.437818 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.437824 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.438615 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.438618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.439173 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.439182 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.439627 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.439630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.439700 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.440203 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:20.440214 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:20.442162 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":113,"threads_started":1}
W20260809 15:41:20.442461 28027 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:20.437030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:54951 (local address 127.14.15.190:42553)
0809 15:41:20.437287 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:20.437290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:20.437304 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:20.437348 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:20.437350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:20.437392 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:20.437478 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:20.437927 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.438491 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.439284 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.439513 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.439596 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.442327 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:54951: BlockingRecv error: recv got EOF from 127.14.15.129:54951 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":105,"threads_started":1}
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:20.636518 28028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:20.630316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:33457)
0809 15:41:20.630652 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:20.630674 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:20.630824 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:20.631177 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:20.631180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:20.631449 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:20.631595 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.631604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.632500 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.632503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.633142 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.633153 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.633702 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.633705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.633772 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.634375 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:20.634391 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:20.636400 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":100,"threads_started":1}
W20260809 15:41:20.636756 28027 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:20.630398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:33457 (local address 127.14.15.190:42553)
0809 15:41:20.630684 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:20.630689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:20.630736 (+ 47us) server_negotiation.cc:407] Connection header received
0809 15:41:20.630945 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:20.630948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:20.631025 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:20.631118 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:20.631724 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.632391 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.633325 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.633597 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.633678 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.636634 (+ 2956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:33457: BlockingRecv error: recv got EOF from 127.14.15.130:33457 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:20 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:20.834517 28030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:20.828456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:40009)
0809 15:41:20.828809 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:20.828829 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:20.828962 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:20.829293 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:20.829296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:20.829562 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:20.829707 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.829715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.830654 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.830659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.831259 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:20.831268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.831736 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.831739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:20.831821 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.832338 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:20.832350 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:20.834395 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":110,"threads_started":1}
W20260809 15:41:20.834700 28027 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:20.828549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:40009 (local address 127.14.15.190:42553)
0809 15:41:20.828707 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:20.828714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:20.828920 (+ 206us) server_negotiation.cc:407] Connection header received
0809 15:41:20.829090 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:20.829093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:20.829154 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:20.829253 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:20.829832 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.830547 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.831388 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:20.831618 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:20.831732 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:20.834569 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:40009: BlockingRecv error: recv got EOF from 127.14.15.131:40009 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:21.452611 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:21.443386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:58751)
0809 15:41:21.443705 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:21.443724 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:21.443838 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:21.444073 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:21.444075 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:21.444262 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:21.444359 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.444364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.445083 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.445085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.445641 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.445649 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.446147 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.446151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.446273 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.450390 (+ 4117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:21.450403 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:21.452463 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":80,"threads_started":1}
W20260809 15:41:21.452836 28032 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:21.443561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:58751 (local address 127.14.15.190:42553)
0809 15:41:21.443829 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:21.443833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:21.443846 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:41:21.443910 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:21.443912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:21.443954 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:21.444032 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:21.444463 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.444988 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.445747 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.445996 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.446141 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.452674 (+ 6533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:58751: BlockingRecv error: recv got EOF from 127.14.15.129:58751 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":91,"threads_started":1}
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:21.643201 28034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:21.637290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:55087)
0809 15:41:21.637637 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:21.637659 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:21.637801 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:21.638086 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:21.638089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:21.638332 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:21.638435 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.638441 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.639219 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.639224 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.639793 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.639802 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.640275 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.640279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.640367 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.640945 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:21.640958 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:21.642995 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":93,"threads_started":1}
W20260809 15:41:21.643219 28032 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:21.637417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:55087 (local address 127.14.15.190:42553)
0809 15:41:21.637602 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:21.637607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:21.637740 (+ 133us) server_negotiation.cc:407] Connection header received
0809 15:41:21.637905 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:21.637908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:21.637964 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:21.638060 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:21.638572 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.639103 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.639921 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.640154 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.640269 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.643119 (+ 2850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:55087: BlockingRecv error: recv got EOF from 127.14.15.130:55087 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:21 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:21.841040 28035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:21.835349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:60959)
0809 15:41:21.835663 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:21.835676 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:21.835775 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:21.836014 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:21.836016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:21.836203 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:21.836304 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.836310 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.837136 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.837139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.837731 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:21.837740 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.838271 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.838279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:21.838364 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.838894 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:21.838906 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:21.840892 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":127,"threads_started":1}
W20260809 15:41:21.841136 28032 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:21.835482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:60959 (local address 127.14.15.190:42553)
0809 15:41:21.835633 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:21.835636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:21.835778 (+ 142us) server_negotiation.cc:407] Connection header received
0809 15:41:21.835850 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:21.835852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:21.835901 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:21.835982 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:21.836444 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.836991 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.837858 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:21.838085 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:21.838170 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:21.841029 (+ 2859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:60959: BlockingRecv error: recv got EOF from 127.14.15.131:60959 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:22.458833 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:22.453427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:33693)
0809 15:41:22.453730 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:22.453743 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:22.453834 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:22.454070 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:22.454072 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:22.454286 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:22.454413 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.454419 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.455161 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.455164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.455736 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.455745 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.456165 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.456168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.456229 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.456826 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:22.456838 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:22.458714 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":117,"threads_started":1}
W20260809 15:41:22.459026 28038 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:22.453536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:33693 (local address 127.14.15.190:42553)
0809 15:41:22.453804 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:22.453808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:22.453823 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:41:22.453904 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:22.453907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:22.453947 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:22.454031 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:22.454514 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.455054 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.455844 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.456061 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.456136 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.458848 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:33693: BlockingRecv error: recv got EOF from 127.14.15.129:33693 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":114,"threads_started":1}
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:22.649932 28039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:22.644145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:33925)
0809 15:41:22.644441 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:22.644455 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:22.644551 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:22.644826 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:22.644828 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:22.645033 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:22.645137 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.645142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.645917 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.645920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.646569 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.646579 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.647144 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.647147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.647216 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.647808 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:22.647822 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:22.649811 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":110,"threads_started":1}
W20260809 15:41:22.650066 28038 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:22.644214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:33925 (local address 127.14.15.190:42553)
0809 15:41:22.644377 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:22.644381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:22.644525 (+ 144us) server_negotiation.cc:407] Connection header received
0809 15:41:22.644625 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:22.644628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:22.644674 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:22.644748 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:22.645246 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.645781 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.646668 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.646986 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.647121 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.649946 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:33925: BlockingRecv error: recv got EOF from 127.14.15.130:33925 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:22 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:22.846951 28040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:22.841837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:47567)
0809 15:41:22.842127 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:22.842141 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:22.842254 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:22.842506 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:22.842508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:22.842698 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:22.842796 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.842801 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.843509 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.843512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.844055 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:22.844062 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.844466 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.844469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:22.844528 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.845010 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:22.845021 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:22.846836 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
W20260809 15:41:22.847160 28038 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:22.841995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:47567 (local address 127.14.15.190:42553)
0809 15:41:22.842132 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:22.842143 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:22.842195 (+ 52us) server_negotiation.cc:407] Connection header received
0809 15:41:22.842344 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:22.842346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:22.842392 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:22.842463 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:22.842895 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.843417 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.844167 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:22.844372 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:22.844445 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:22.847018 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:47567: BlockingRecv error: recv got EOF from 127.14.15.131:47567 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:23.465611 28041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:23.459678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:47417)
0809 15:41:23.459998 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:23.460012 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:23.460112 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:23.460412 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:23.460414 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:23.460611 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:23.460710 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.460715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.461562 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.461566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.462344 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.462358 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.462855 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.462861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.462956 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.463615 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:23.463627 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:23.465485 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":88,"threads_started":1}
W20260809 15:41:23.465832 28042 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:23.459816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:47417 (local address 127.14.15.190:42553)
0809 15:41:23.460055 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:23.460058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:23.460072 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:23.460236 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:23.460240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:23.460290 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:23.460381 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:23.460839 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.461442 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.462477 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.462733 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.462819 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.465670 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:47417: BlockingRecv error: recv got EOF from 127.14.15.129:47417 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":68,"threads_started":1}
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:23.656414 28043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:23.650843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:51001)
0809 15:41:23.651202 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:23.651219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:23.651351 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:23.651669 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:23.651673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:23.651886 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:23.652025 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.652036 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.652832 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.652835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.653392 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.653400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.653869 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.653872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.653932 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.654489 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:23.654501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:23.656299 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":109,"threads_started":1}
W20260809 15:41:23.656600 28042 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:23.650951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51001 (local address 127.14.15.190:42553)
0809 15:41:23.651119 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:23.651124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:23.651297 (+ 173us) server_negotiation.cc:407] Connection header received
0809 15:41:23.651456 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:23.651459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:23.651525 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:23.651609 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:23.652164 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.652733 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.653531 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.653754 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.653845 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.656466 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:51001: BlockingRecv error: recv got EOF from 127.14.15.130:51001 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:23 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:23.853582 28044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:23.847928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:59267)
0809 15:41:23.848255 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:23.848267 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:23.848405 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:23.848702 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:23.848705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:23.848895 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:23.849001 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.849006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.849753 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.849756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.850415 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:23.850425 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.850849 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.850852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:23.850917 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.851432 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:23.851444 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:23.853405 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
W20260809 15:41:23.853648 28042 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:23.847974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:59267 (local address 127.14.15.190:42553)
0809 15:41:23.848107 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:23.848112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:23.848329 (+ 217us) server_negotiation.cc:407] Connection header received
0809 15:41:23.848520 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:23.848523 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:23.848584 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:23.848657 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:23.849102 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.849623 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.850525 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:23.850743 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:23.850819 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:23.853529 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:59267: BlockingRecv error: recv got EOF from 127.14.15.131:59267 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:24.471614 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:24.466508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:37393)
0809 15:41:24.466798 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:24.466812 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:24.466912 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:24.467140 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:24.467142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:24.467326 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:24.467423 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.467429 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.468147 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.468150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.468700 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.468707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.469112 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.469114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.469176 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.469691 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:24.469703 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:24.471487 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":90,"threads_started":1}
W20260809 15:41:24.471761 28046 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:24.466573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:37393 (local address 127.14.15.190:42553)
0809 15:41:24.466822 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:24.466825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:24.466865 (+ 40us) server_negotiation.cc:407] Connection header received
0809 15:41:24.466980 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:24.466982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:24.467025 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:24.467102 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:24.467536 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.468056 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.468801 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.469016 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.469090 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.471628 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:37393: BlockingRecv error: recv got EOF from 127.14.15.129:37393 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":63,"threads_started":1}
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:24.662533 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:24.657214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:51623)
0809 15:41:24.657508 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:24.657521 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:24.657632 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:24.657873 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:24.657876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:24.658064 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:24.658165 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.658170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.658946 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.658948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.659509 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.659517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.659910 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.659912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.659973 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.660467 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:24.660478 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:24.662415 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":118,"threads_started":1}
W20260809 15:41:24.662670 28046 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:24.657346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51623 (local address 127.14.15.190:42553)
0809 15:41:24.657493 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:24.657496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:24.657597 (+ 101us) server_negotiation.cc:407] Connection header received
0809 15:41:24.657712 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:24.657715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:24.657761 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:24.657832 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:24.658326 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.658848 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.659613 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.659815 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.659889 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.662549 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:51623: BlockingRecv error: recv got EOF from 127.14.15.130:51623 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:24 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:24.859786 28048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:24.854399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:50835)
0809 15:41:24.854709 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:24.854722 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:24.854820 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:24.855049 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:24.855051 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:24.855248 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:24.855348 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.855353 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.856113 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.856116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.856668 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:24.856675 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.857119 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.857121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:24.857179 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.857665 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:24.857677 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:24.859610 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":118,"threads_started":1}
W20260809 15:41:24.859831 28046 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:24.854488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:50835 (local address 127.14.15.190:42553)
0809 15:41:24.854660 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:24.854668 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:24.854778 (+ 110us) server_negotiation.cc:407] Connection header received
0809 15:41:24.854887 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:24.854889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:24.854940 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:24.855007 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:24.855485 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.856014 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.856779 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:24.857014 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:24.857096 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:24.859730 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:50835: BlockingRecv error: recv got EOF from 127.14.15.131:50835 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:25.477923 28049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:25.472562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:60441)
0809 15:41:25.472844 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:25.472858 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:25.472959 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:25.473221 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:25.473223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:25.473412 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:25.473550 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.473562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.474347 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.474351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.474928 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.474937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.475359 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.475361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.475422 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.475997 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:25.476009 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:25.477795 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":106,"threads_started":1}
W20260809 15:41:25.478119 28050 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:25.472631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:60441 (local address 127.14.15.190:42553)
0809 15:41:25.472868 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:25.472872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:25.472911 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:41:25.473049 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:25.473052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:25.473104 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:25.473183 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:25.473674 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.474204 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.475037 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.475264 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.475340 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.477927 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:60441: BlockingRecv error: recv got EOF from 127.14.15.129:60441 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:25.668903 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:25.663302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:59279)
0809 15:41:25.663695 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:25.663708 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:25.663807 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:25.664043 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:25.664045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:25.664239 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:25.664339 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.664344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.665049 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.665052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.665650 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.665659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.666109 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.666112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.666182 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.666829 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:25.666841 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:25.668777 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":205,"threads_started":1}
W20260809 15:41:25.669061 28050 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:25.663448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:59279 (local address 127.14.15.190:42553)
0809 15:41:25.663591 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:25.663595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:25.663776 (+ 181us) server_negotiation.cc:407] Connection header received
0809 15:41:25.663886 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:25.663888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:25.663934 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:25.664005 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:25.664441 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.664943 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.665755 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.665967 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.666043 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.668900 (+ 2857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:59279: BlockingRecv error: recv got EOF from 127.14.15.130:59279 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:25 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:25.866070 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:25.860675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:36907)
0809 15:41:25.860935 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:25.860949 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:25.861062 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:25.861303 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:25.861305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:25.861498 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:25.861611 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.861617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.862376 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.862378 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.862947 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:25.862955 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.863372 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.863375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:25.863435 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.863953 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:25.863965 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:25.865866 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":93,"threads_started":1}
W20260809 15:41:25.866091 28050 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:25.860768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:36907 (local address 127.14.15.190:42553)
0809 15:41:25.860916 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:25.860920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:25.861034 (+ 114us) server_negotiation.cc:407] Connection header received
0809 15:41:25.861142 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:25.861144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:25.861193 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:25.861265 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:25.861711 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.862272 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.863058 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:25.863274 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:25.863354 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:25.865985 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:36907: BlockingRecv error: recv got EOF from 127.14.15.131:36907 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:26.487480 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:26.478734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:34301)
0809 15:41:26.479025 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:26.479040 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:26.479137 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:26.479404 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:26.479406 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:26.479620 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:26.479720 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.479726 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.480437 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.480440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.481009 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.481017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.481424 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.481427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.481493 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.485060 (+ 3567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:26.485072 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:26.487287 (+ 2215us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":97,"threads_started":1}
W20260809 15:41:26.487555 28055 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:26.478794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:34301 (local address 127.14.15.190:42553)
0809 15:41:26.479090 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:26.479094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:26.479108 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:26.479228 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:26.479230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:26.479274 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:26.479359 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:26.479822 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.480342 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.481112 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.481326 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.481400 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.487421 (+ 6021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:34301: BlockingRecv error: recv got EOF from 127.14.15.129:34301 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":61,"threads_started":1}
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:26.675484 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:26.669728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:51835)
0809 15:41:26.670074 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:26.670095 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:26.670256 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:26.670539 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:26.670542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:26.670773 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:26.670871 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.670877 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.671694 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.671698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.672284 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.672293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.672784 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.672787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.672887 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.673403 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:26.673414 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:26.675295 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":96,"threads_started":1}
W20260809 15:41:26.675557 28055 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:26.669850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51835 (local address 127.14.15.190:42553)
0809 15:41:26.670022 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:26.670027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:26.670173 (+ 146us) server_negotiation.cc:407] Connection header received
0809 15:41:26.670363 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:26.670366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:26.670418 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:26.670512 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:26.671013 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.671571 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.672412 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.672663 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.672778 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.675438 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:51835: BlockingRecv error: recv got EOF from 127.14.15.130:51835 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:26 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.131@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:26.872921 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:26.866975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.131:45863)
0809 15:41:26.867288 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:26.867301 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:26.867443 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:26.867730 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:26.867733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:26.867962 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:26.868060 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.868066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.868832 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.868837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.869521 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:26.869530 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.870031 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.870034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:26.870162 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.870831 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:26.870844 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:26.872771 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":111,"threads_started":1}
W20260809 15:41:26.873081 28055 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:26.867047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:45863 (local address 127.14.15.190:42553)
0809 15:41:26.867227 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:26.867233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:26.867380 (+ 147us) server_negotiation.cc:407] Connection header received
0809 15:41:26.867553 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:26.867556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:26.867614 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:26.867703 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:26.868184 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.868720 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.869639 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:26.869890 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:26.870000 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:26.872958 (+ 2958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.131:45863: BlockingRecv error: recv got EOF from 127.14.15.131:45863 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 15:41:27 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:27 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.129@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:27.493832 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:27.488437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.129:46607)
0809 15:41:27.488762 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:27.488776 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:27.488869 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:27.489144 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:27.489146 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:27.489336 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:27.489436 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:27.489442 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.490153 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.490155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:27.490758 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:27.490767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.491176 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.491179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:27.491240 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:27.491745 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:27.491756 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:27.493644 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":72,"threads_started":1}
W20260809 15:41:27.493894 28061 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:27.488522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:46607 (local address 127.14.15.190:42553)
0809 15:41:27.488809 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:27.488813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:27.488827 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:41:27.488975 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:27.488978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:27.489022 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:27.489101 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:27.489534 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.490057 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.490857 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.491080 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.491155 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:27.493768 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.129:46607: BlockingRecv error: recv got EOF from 127.14.15.129:46607 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":117,"threads_started":1}
Aug 09 15:41:27 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:41:27 dist-test-slave-jztv krb5kdc[26492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.15.130@KRBTEST.COM for oryx/127.14.15.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:41:27.681870 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:27.676496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42553 (local address 127.14.15.130:51741)
0809 15:41:27.676760 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:27.676773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:27.676867 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:27.677112 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:27.677114 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:27.677301 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:27.677399 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:27.677404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.678116 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.678118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:27.678733 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:27.678742 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.679150 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.679152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:27.679214 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:27.679783 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:27.679795 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:27.681742 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.15.190:42553: Server oryx/127.14.15.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
W20260809 15:41:27.681974 28061 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:27.676534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51741 (local address 127.14.15.190:42553)
0809 15:41:27.676689 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:27.676692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:27.676846 (+ 154us) server_negotiation.cc:407] Connection header received
0809 15:41:27.676948 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:27.676950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:27.676997 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:27.677074 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:27.677513 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.678025 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.678848 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:27.679056 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:27.679131 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:27.681878 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.15.130:51741: BlockingRecv error: recv got EOF from 127.14.15.130:51741 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:41:27.765460 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 27380
I20260809 15:41:27.787663 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 27595
I20260809 15:41:27.799338 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 27789
I20260809 15:41:27.811290 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 27280
2026-08-09T15:41:27Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18303 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T15:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:27Z Disabled control of system clock
I20260809 15:41:27.852888 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:32873
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:32873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 15:41:27.969765 28069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:27.970029 28069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:27.970063 28069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:27.973984 28069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:27.974045 28069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:27.974061 28069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:27.974077 28069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:27.974092 28069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:27.978981 28069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:32873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:32873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:27.980019 28069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:27.981343 28069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:27.990589 28075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:27.990604 28077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:27.990657 28069 server_base.cc:1034] running on GCE node
W20260809 15:41:27.990604 28081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:27.991411 28069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:27.992440 28069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:27.993593 28069 hybrid_clock.cc:648] HybridClock initialized: now 1786290087993566 us; error 41 us; skew 500 ppm
I20260809 15:41:27.995596 28069 webserver.cc:460] Webserver started at http://127.14.15.190:44825/ using document root <none> and password file <none>
I20260809 15:41:27.996198 28069 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:27.996263 28069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:27.996500 28069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:27.998737 28069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "dc46b25346d849889753dbbde1f5497e"
format_stamp: "Formatted at 2026-08-09 15:41:27 on dist-test-slave-jztv"
server_key: "560ffb8b3d9ca6922275a61e80b70013"
server_key_iv: "0d662a865aad8c1c376938e6fad0567a"
server_key_version: "encryptionkey@0"
I20260809 15:41:27.999329 28069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "dc46b25346d849889753dbbde1f5497e"
format_stamp: "Formatted at 2026-08-09 15:41:27 on dist-test-slave-jztv"
server_key: "560ffb8b3d9ca6922275a61e80b70013"
server_key_iv: "0d662a865aad8c1c376938e6fad0567a"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.003113 28069 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:41:28.005646 28092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.006963 28069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:28.007128 28069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "dc46b25346d849889753dbbde1f5497e"
format_stamp: "Formatted at 2026-08-09 15:41:27 on dist-test-slave-jztv"
server_key: "560ffb8b3d9ca6922275a61e80b70013"
server_key_iv: "0d662a865aad8c1c376938e6fad0567a"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.007247 28069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:28.018131 28069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:28.018913 28069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:28.019124 28069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:28.026263 28069 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:32873
I20260809 15:41:28.026293 28165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:32873 every 8 connection(s)
I20260809 15:41:28.027253 28069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:28.029238 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28069
I20260809 15:41:28.029383 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:41:28.029685 14398 external_mini_cluster.cc:1428] Setting key 7c25d1a117b68cb8085f8c34aa9d2a39
I20260809 15:41:28.031533 28167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:28.037211 28167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e: Bootstrap starting.
I20260809 15:41:28.039023 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.031073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.14.15.190:32873)
0809 15:41:28.031719 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.031736 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.031772 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:41:28.032417 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.032434 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.032819 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.033153 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.033594 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.034664 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.035555 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.036021 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.036206 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.037204 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:28.037209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:28.037221 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:28.037678 (+ 457us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:28.037733 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:28.037753 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:28.037864 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:28.038020 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 15:41:28.038331 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":112,"threads_started":1}
I20260809 15:41:28.039577 28167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:28.040499 28167 log.cc:824] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:28.042572 28167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e: No bootstrap required, opened a new log
I20260809 15:41:28.046193 28167 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } }
I20260809 15:41:28.046473 28167 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:28.046512 28167 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc46b25346d849889753dbbde1f5497e, State: Initialized, Role: FOLLOWER
I20260809 15:41:28.046862 28167 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } }
I20260809 15:41:28.046991 28167 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:28.047030 28167 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:28.047101 28167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:28.047928 28167 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } }
I20260809 15:41:28.048215 28167 leader_election.cc:302] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc46b25346d849889753dbbde1f5497e; no voters:
I20260809 15:41:28.048514 28167 leader_election.cc:288] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:41:28.048633 28176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:28.048898 28176 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [term 1 LEADER]: Becoming Leader. State: Replica: dc46b25346d849889753dbbde1f5497e, State: Running, Role: LEADER
I20260809 15:41:28.049283 28176 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } }
I20260809 15:41:28.049782 28167 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:28.051043 28181 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc46b25346d849889753dbbde1f5497e. Latest consensus state: current_term: 1 leader_uuid: "dc46b25346d849889753dbbde1f5497e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } } }
I20260809 15:41:28.051000 28179 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc46b25346d849889753dbbde1f5497e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc46b25346d849889753dbbde1f5497e" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 32873 } } }
I20260809 15:41:28.051224 28181 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:28.051268 28179 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:28.051625 28188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:28.054826 28188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:28.060045 28188 catalog_manager.cc:1347] Generated new cluster ID: 37a97f1110b141f0a8f38edb6659e95f
I20260809 15:41:28.060111 28188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:28.068957 28188 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:41:28.070171 28188 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:28.076325 28188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc46b25346d849889753dbbde1f5497e: Generated new TSK 0
I20260809 15:41:28.077280 28188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:41:28.087126 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--builtin_ntp_servers=127.14.15.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 15:41:28.209148 28203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:28.209437 28203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:28.209478 28203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:28.213887 28203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:28.213967 28203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:28.214025 28203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:28.219069 28203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:28.220247 28203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:28.221699 28203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:28.232249 28211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.232252 28210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.232295 28203 server_base.cc:1034] running on GCE node
W20260809 15:41:28.232252 28215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.233017 28203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:28.233687 28203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:28.234851 28203 hybrid_clock.cc:648] HybridClock initialized: now 1786290088234847 us; error 49 us; skew 500 ppm
I20260809 15:41:28.236842 28203 webserver.cc:460] Webserver started at http://127.14.15.129:43399/ using document root <none> and password file <none>
I20260809 15:41:28.237445 28203 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:28.237514 28203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:28.237784 28203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:28.239996 28203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "d9dd2b1708a64781b0bdc5829fa6775f"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "94ec0218fa9e21438ce349e5ee1031a7"
server_key_iv: "8cbbb61eb8eddb9599ef72e98a144ee4"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.240615 28203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "d9dd2b1708a64781b0bdc5829fa6775f"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "94ec0218fa9e21438ce349e5ee1031a7"
server_key_iv: "8cbbb61eb8eddb9599ef72e98a144ee4"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.244647 28203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 15:41:28.247388 28225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.248687 28203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:28.248838 28203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "d9dd2b1708a64781b0bdc5829fa6775f"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "94ec0218fa9e21438ce349e5ee1031a7"
server_key_iv: "8cbbb61eb8eddb9599ef72e98a144ee4"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.248966 28203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:28.282128 28203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:28.282923 28203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:28.283152 28203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:28.283788 28203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:28.285274 28203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:28.285346 28203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.285413 28203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:28.285444 28203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.294968 28203 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:35179
I20260809 15:41:28.294991 28384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:35179 every 8 connection(s)
I20260809 15:41:28.295922 28203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:28.305099 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.297781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:43549 (local address 127.14.15.190:32873)
0809 15:41:28.297939 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.297943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.299076 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 15:41:28.300447 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.300450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.300504 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.300590 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.301482 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.302006 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.303217 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.303427 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.303510 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.304668 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:28.304671 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:28.304673 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:28.304686 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:28.304704 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:28.304712 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:28.304772 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:28.304909 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 15:41:28.304978 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:41:28.305962 28388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.298193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:32873 (local address 127.14.15.129:43549)
0809 15:41:28.298917 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:28.298971 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:28.300258 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:28.300760 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:28.300766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:28.300852 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:28.301355 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.301368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.302125 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.302128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.303103 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.303114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.303579 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.303583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.303761 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.304407 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:28.304409 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:28.304454 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:28.304518 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:28.304786 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:28.304794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:28.304798 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:41:28.304891 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 15:41:28.305116 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":117,"threads_started":1}
I20260809 15:41:28.306244 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28203
I20260809 15:41:28.306401 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:41:28.306710 14398 external_mini_cluster.cc:1428] Setting key bec62832d0b40b69a6c963cfc43a1b8d
I20260809 15:41:28.307315 28385 heartbeater.cc:347] Connected to a master server at 127.14.15.190:32873
I20260809 15:41:28.307588 28385 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:28.308243 28385 heartbeater.cc:511] Master 127.14.15.190:32873 requested a full tablet report, sending...
I20260809 15:41:28.309019 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--builtin_ntp_servers=127.14.15.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 15:41:28.309887 28117 ts_manager.cc:194] Registered new tserver with Master: d9dd2b1708a64781b0bdc5829fa6775f (127.14.15.129:35179)
I20260809 15:41:28.311519 28117 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.129:43549
W20260809 15:41:28.423002 28390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:28.423278 28390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:28.423316 28390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:28.427443 28390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:28.427495 28390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:28.427547 28390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:28.432272 28390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:28.433360 28390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:28.434756 28390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:28.444850 28397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.444854 28395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.444854 28400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.444991 28390 server_base.cc:1034] running on GCE node
I20260809 15:41:28.445653 28390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:28.446400 28390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:28.447582 28390 hybrid_clock.cc:648] HybridClock initialized: now 1786290088447567 us; error 28 us; skew 500 ppm
I20260809 15:41:28.449371 28390 webserver.cc:460] Webserver started at http://127.14.15.130:42189/ using document root <none> and password file <none>
I20260809 15:41:28.450042 28390 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:28.450135 28390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:28.450433 28390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:28.452683 28390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "5c1803a6fc9e427383bec8c9b721f708"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "46b693091c30777876d85b5e7a40e918"
server_key_iv: "bc4a8755f0f5f58902696ae9e2263137"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.453317 28390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "5c1803a6fc9e427383bec8c9b721f708"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "46b693091c30777876d85b5e7a40e918"
server_key_iv: "bc4a8755f0f5f58902696ae9e2263137"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.457217 28390 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:41:28.459868 28406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.461151 28390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:28.461289 28390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "5c1803a6fc9e427383bec8c9b721f708"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "46b693091c30777876d85b5e7a40e918"
server_key_iv: "bc4a8755f0f5f58902696ae9e2263137"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.461411 28390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:28.488696 28390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:28.489436 28390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:28.489650 28390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:28.490337 28390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:28.491336 28390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:28.491410 28390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.491513 28390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:28.491567 28390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.500797 28390 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:43983
I20260809 15:41:28.500826 28566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:43983 every 8 connection(s)
I20260809 15:41:28.501709 28390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:28.507072 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28390
I20260809 15:41:28.507221 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:41:28.507587 14398 external_mini_cluster.cc:1428] Setting key 6c9cb923361a5d525cf27174506ac332
I20260809 15:41:28.509866 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--builtin_ntp_servers=127.14.15.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 15:41:28.511981 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.503711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53405 (local address 127.14.15.190:32873)
0809 15:41:28.503910 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.503915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.504885 (+ 970us) server_negotiation.cc:407] Connection header received
0809 15:41:28.506270 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.506272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.506321 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.506400 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.507319 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.508080 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.509633 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.509997 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.510119 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.511378 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:28.511385 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:28.511391 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:28.511410 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:28.511436 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:28.511458 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:28.511540 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:28.511692 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 15:41:28.511773 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 15:41:28.512836 28573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.504091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:32873 (local address 127.14.15.130:53405)
0809 15:41:28.504742 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:28.504782 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:28.506040 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:28.506565 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:28.506572 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:28.506651 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:28.507135 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.507148 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.508243 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.508247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.509497 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.509506 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.510201 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.510204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.510397 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.511069 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:28.511071 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:28.511111 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:28.511216 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:28.511547 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:28.511554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:28.511558 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:41:28.511656 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 15:41:28.511879 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":116,"threads_started":1}
I20260809 15:41:28.513996 28567 heartbeater.cc:347] Connected to a master server at 127.14.15.190:32873
I20260809 15:41:28.514271 28567 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:28.514935 28567 heartbeater.cc:511] Master 127.14.15.190:32873 requested a full tablet report, sending...
I20260809 15:41:28.516122 28117 ts_manager.cc:194] Registered new tserver with Master: 5c1803a6fc9e427383bec8c9b721f708 (127.14.15.130:43983)
I20260809 15:41:28.516743 28117 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.130:53405
W20260809 15:41:28.630504 28574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:28.630753 28574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:28.630791 28574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:28.634907 28574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:28.634974 28574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:28.635061 28574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:28.639891 28574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:32873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:28.641022 28574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:28.642418 28574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:28.652529 28582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.652601 28585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.652546 28581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.652915 28574 server_base.cc:1034] running on GCE node
I20260809 15:41:28.653368 28574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:28.654088 28574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:28.655287 28574 hybrid_clock.cc:648] HybridClock initialized: now 1786290088655275 us; error 35 us; skew 500 ppm
I20260809 15:41:28.657198 28574 webserver.cc:460] Webserver started at http://127.14.15.131:36173/ using document root <none> and password file <none>
I20260809 15:41:28.657778 28574 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:28.657869 28574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:28.658119 28574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:28.660269 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "2fc0b46990b548a6b8ed999c95e51709"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "fa49e72c714221767df6ac7e5eee6778"
server_key_iv: "bccf0e9480d7ba18a8c9801403efe32d"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.660848 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "2fc0b46990b548a6b8ed999c95e51709"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "fa49e72c714221767df6ac7e5eee6778"
server_key_iv: "bccf0e9480d7ba18a8c9801403efe32d"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.664587 28574 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:41:28.667202 28593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.668347 28574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:28.668483 28574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "2fc0b46990b548a6b8ed999c95e51709"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "fa49e72c714221767df6ac7e5eee6778"
server_key_iv: "bccf0e9480d7ba18a8c9801403efe32d"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.668602 28574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:28.692400 28574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:28.693181 28574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:28.693398 28574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:28.694063 28574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:28.695124 28574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:28.695201 28574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.695277 28574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:28.695330 28574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.704433 28574 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:44843
I20260809 15:41:28.704468 28751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:44843 every 8 connection(s)
I20260809 15:41:28.705363 28574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:28.708618 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28574
I20260809 15:41:28.708732 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:41:28.709048 14398 external_mini_cluster.cc:1428] Setting key d063cd065b680b5c57dc865474c44d52
I20260809 15:41:28.715436 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.707302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:56291 (local address 127.14.15.190:32873)
0809 15:41:28.707463 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.707467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.708444 (+ 977us) server_negotiation.cc:407] Connection header received
0809 15:41:28.710307 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.710311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.710390 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.710479 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.711581 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.712149 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.713344 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.713596 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.713690 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.714914 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:28.714918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:28.714920 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:28.714932 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:28.714952 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:28.714960 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:28.715023 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:28.715252 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 15:41:28.715309 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:41:28.716316 28755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.707629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:32873 (local address 127.14.15.131:56291)
0809 15:41:28.708259 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:28.708297 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:28.710035 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:28.710676 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:28.710683 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:28.710763 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:28.711414 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.711435 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.712280 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.712284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.713213 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:28.713223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:28.713769 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:28.713773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:28.713924 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:28.714652 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:28.714654 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:28.714696 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:28.714764 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:28.715072 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:28.715081 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:28.715087 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:41:28.715210 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:41:28.715463 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":111,"threads_started":1}
I20260809 15:41:28.717500 28752 heartbeater.cc:347] Connected to a master server at 127.14.15.190:32873
I20260809 15:41:28.717720 28752 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:28.718201 28752 heartbeater.cc:511] Master 127.14.15.190:32873 requested a full tablet report, sending...
I20260809 15:41:28.719270 28117 ts_manager.cc:194] Registered new tserver with Master: 2fc0b46990b548a6b8ed999c95e51709 (127.14.15.131:44843)
I20260809 15:41:28.719828 28117 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.131:56291
I20260809 15:41:28.723088 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:41:28.725852 28173 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:28.725092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.14.15.190:32873)
0809 15:41:28.725217 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.725220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.725339 (+ 119us) server_negotiation.cc:407] Connection header received
0809 15:41:28.725437 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.725439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.725477 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.725543 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.725755 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35708: BlockingRecv error: recv got EOF from 127.0.0.1:35708 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:41:28.726152 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28203
I20260809 15:41:28.743717 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28390
I20260809 15:41:28.764415 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28574
I20260809 15:41:28.777303 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28069
2026-08-09T15:41:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (963 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T15:41:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:28Z Disabled control of system clock
I20260809 15:41:28.814963 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39747
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 15:41:28.931169 28764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:28.931447 28764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:28.931492 28764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:28.935542 28764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:28.935611 28764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:28.935627 28764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:28.935644 28764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:28.935660 28764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:28.940644 28764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39747
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:28.941741 28764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:28.943187 28764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:28.951838 28773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:28.951845 28775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.951961 28764 server_base.cc:1034] running on GCE node
W20260809 15:41:28.952134 28771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:28.952713 28764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:28.953778 28764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:28.954952 28764 hybrid_clock.cc:648] HybridClock initialized: now 1786290088954921 us; error 40 us; skew 500 ppm
I20260809 15:41:28.956920 28764 webserver.cc:460] Webserver started at http://127.14.15.190:34701/ using document root <none> and password file <none>
I20260809 15:41:28.957474 28764 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:28.957538 28764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:28.957710 28764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:28.959851 28764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "18f29c9b00854740b0a77e99bf4a6960"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "0057e48fc04fbf37d56bccf60cd27033"
server_key_iv: "5745163fe519df443b4bcaf74aff4633"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.960397 28764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "18f29c9b00854740b0a77e99bf4a6960"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "0057e48fc04fbf37d56bccf60cd27033"
server_key_iv: "5745163fe519df443b4bcaf74aff4633"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.964359 28764 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 15:41:28.966954 28782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:28.968178 28764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:41:28.968312 28764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "18f29c9b00854740b0a77e99bf4a6960"
format_stamp: "Formatted at 2026-08-09 15:41:28 on dist-test-slave-jztv"
server_key: "0057e48fc04fbf37d56bccf60cd27033"
server_key_iv: "5745163fe519df443b4bcaf74aff4633"
server_key_version: "encryptionkey@0"
I20260809 15:41:28.968436 28764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:28.973179 28764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:28.973807 28764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:28.973999 28764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:28.981444 28764 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39747
I20260809 15:41:28.981473 28868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39747 every 8 connection(s)
I20260809 15:41:28.982484 28764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:28.985803 28870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:28.991119 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28764
I20260809 15:41:28.991261 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:41:28.991454 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960: Bootstrap starting.
I20260809 15:41:28.991583 14398 external_mini_cluster.cc:1428] Setting key 2a7dcea5ea65951dff41e6dc26f85a19
I20260809 15:41:28.994006 28870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:28.994796 28870 log.cc:824] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:28.996953 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:28.992921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.14.15.190:39747)
0809 15:41:28.993552 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:28.993567 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:28.993610 (+ 43us) server_negotiation.cc:407] Connection header received
0809 15:41:28.994325 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:28.994345 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:28.994695 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:28.995022 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:28.995737 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:28.995742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:28.995752 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:28.995761 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:28.995809 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:28.995824 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:28.995939 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:28.996068 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 15:41:28.996308 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":135,"threads_started":1}
I20260809 15:41:28.997027 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960: No bootstrap required, opened a new log
I20260809 15:41:29.000577 28870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } }
I20260809 15:41:29.000835 28870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:29.000926 28870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f29c9b00854740b0a77e99bf4a6960, State: Initialized, Role: FOLLOWER
I20260809 15:41:29.001339 28870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } }
I20260809 15:41:29.001492 28870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:29.001577 28870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:29.001698 28870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:29.002669 28870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } }
I20260809 15:41:29.003005 28870 leader_election.cc:302] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18f29c9b00854740b0a77e99bf4a6960; no voters:
I20260809 15:41:29.003325 28870 leader_election.cc:288] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:41:29.003419 28876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:29.003721 28876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [term 1 LEADER]: Becoming Leader. State: Replica: 18f29c9b00854740b0a77e99bf4a6960, State: Running, Role: LEADER
I20260809 15:41:29.004065 28876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } }
I20260809 15:41:29.004609 28870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:29.005703 28880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18f29c9b00854740b0a77e99bf4a6960. Latest consensus state: current_term: 1 leader_uuid: "18f29c9b00854740b0a77e99bf4a6960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } } }
I20260809 15:41:29.005836 28880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:29.006239 28887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:29.006148 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18f29c9b00854740b0a77e99bf4a6960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18f29c9b00854740b0a77e99bf4a6960" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39747 } } }
I20260809 15:41:29.006407 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960 [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:29.009087 28887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:29.014518 28887 catalog_manager.cc:1347] Generated new cluster ID: f23707f5bdb84da8bd4c3a418c3947d4
I20260809 15:41:29.014581 28887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:29.026376 28887 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:41:29.026711 28887 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:29.042667 28887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18f29c9b00854740b0a77e99bf4a6960: Generated new TSK 0
I20260809 15:41:29.043576 28887 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:41:29.053560 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--builtin_ntp_servers=127.14.15.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 15:41:29.168833 28898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:29.169148 28898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:29.169224 28898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:29.173508 28898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:29.173593 28898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:29.173689 28898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:29.178627 28898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:29.179770 28898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:29.181180 28898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:29.190625 28905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.190676 28912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.190646 28909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:29.191013 28898 server_base.cc:1034] running on GCE node
I20260809 15:41:29.191469 28898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:29.192095 28898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:29.193300 28898 hybrid_clock.cc:648] HybridClock initialized: now 1786290089193289 us; error 29 us; skew 500 ppm
I20260809 15:41:29.195188 28898 webserver.cc:460] Webserver started at http://127.14.15.129:41697/ using document root <none> and password file <none>
I20260809 15:41:29.195771 28898 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:29.195864 28898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:29.196111 28898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:29.198146 28898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "1f550df1ed9543b4a658e0f74e7108e4"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "7a5092c5c63b0b31429103e3568a2c6e"
server_key_iv: "a179e4fbbbd49a765329119be8bad643"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.198769 28898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "1f550df1ed9543b4a658e0f74e7108e4"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "7a5092c5c63b0b31429103e3568a2c6e"
server_key_iv: "a179e4fbbbd49a765329119be8bad643"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.202584 28898 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:41:29.205205 28919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.206594 28898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:29.206688 28898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "1f550df1ed9543b4a658e0f74e7108e4"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "7a5092c5c63b0b31429103e3568a2c6e"
server_key_iv: "a179e4fbbbd49a765329119be8bad643"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.206779 28898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:29.211599 28898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:29.212170 28898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:29.212307 28898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:29.212777 28898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:29.213660 28898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:29.213707 28898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.213745 28898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:29.213765 28898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.222343 28898 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:36717
I20260809 15:41:29.222355 29074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:36717 every 8 connection(s)
I20260809 15:41:29.223266 28898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:29.229369 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.225142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:58005 (local address 127.14.15.190:39747)
0809 15:41:29.225320 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:29.225325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:29.226520 (+ 1195us) server_negotiation.cc:407] Connection header received
0809 15:41:29.227823 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:29.227826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:29.227863 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:29.227946 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:29.228989 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:29.228992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:29.228994 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:29.229005 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:29.229024 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:29.229032 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:29.229120 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:29.229223 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 15:41:29.229263 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:41:29.230281 29079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.225588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39747 (local address 127.14.15.129:58005)
0809 15:41:29.226354 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:29.226407 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:29.227628 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:29.228081 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:29.228087 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:29.228174 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:29.228706 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:29.228708 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:29.228760 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:29.228829 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:29.229105 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:29.229109 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:29.229113 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:41:29.229239 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 15:41:29.229431 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":141,"threads_started":1}
I20260809 15:41:29.231195 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 28898
I20260809 15:41:29.231328 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:41:29.231653 14398 external_mini_cluster.cc:1428] Setting key 507ab8efec11211b68bb29c97ca00644
I20260809 15:41:29.231644 29075 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39747
I20260809 15:41:29.231873 29075 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:29.232281 29075 heartbeater.cc:511] Master 127.14.15.190:39747 requested a full tablet report, sending...
I20260809 15:41:29.233693 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--builtin_ntp_servers=127.14.15.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 15:41:29.233877 28816 ts_manager.cc:194] Registered new tserver with Master: 1f550df1ed9543b4a658e0f74e7108e4 (127.14.15.129:36717)
W20260809 15:41:29.347024 29080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:29.347348 29080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:29.347422 29080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:29.351563 29080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:29.351641 29080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:29.351729 29080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:29.356421 29080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:29.357614 29080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:29.359103 29080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:29.368824 29091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.368824 29089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.368829 29088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:29.369184 29080 server_base.cc:1034] running on GCE node
I20260809 15:41:29.369635 29080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:29.370334 29080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:29.371511 29080 hybrid_clock.cc:648] HybridClock initialized: now 1786290089371484 us; error 41 us; skew 500 ppm
I20260809 15:41:29.373557 29080 webserver.cc:460] Webserver started at http://127.14.15.130:33327/ using document root <none> and password file <none>
I20260809 15:41:29.374141 29080 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:29.374254 29080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:29.374490 29080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:29.376518 29080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "0969a5d7c1e74470b85f7f4833b52264"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "9217265c9cd6b7206ee72e0e4d8d0b59"
server_key_iv: "ccfeaf8cb94344276f45e0af9ab2a87e"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.377084 29080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "0969a5d7c1e74470b85f7f4833b52264"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "9217265c9cd6b7206ee72e0e4d8d0b59"
server_key_iv: "ccfeaf8cb94344276f45e0af9ab2a87e"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.380811 29080 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:41:29.383384 29098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.384557 29080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:41:29.384694 29080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "0969a5d7c1e74470b85f7f4833b52264"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "9217265c9cd6b7206ee72e0e4d8d0b59"
server_key_iv: "ccfeaf8cb94344276f45e0af9ab2a87e"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.384809 29080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:29.389288 29080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:29.389886 29080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:29.390075 29080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:29.390741 29080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:29.391649 29080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:29.391721 29080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.391786 29080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:29.391839 29080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.400357 29080 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:34057
I20260809 15:41:29.400381 29279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:34057 every 8 connection(s)
I20260809 15:41:29.401227 29080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:29.407800 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.403131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:39635 (local address 127.14.15.190:39747)
0809 15:41:29.403280 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:29.403284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:29.404326 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 15:41:29.405916 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:29.405920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:29.405969 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:29.406071 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:29.407292 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:29.407296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:29.407299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:29.407316 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:29.407335 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:29.407344 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:29.407438 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:29.407616 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 15:41:29.407663 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:41:29.408638 29284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.403527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39747 (local address 127.14.15.130:39635)
0809 15:41:29.404170 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:29.404211 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:29.405699 (+ 1488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:29.406289 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:29.406297 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:29.406424 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:29.407022 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:29.407024 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:29.407062 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:29.407128 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:29.407434 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:29.407454 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:29.407462 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:41:29.407655 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:41:29.407892 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":107,"threads_started":1}
I20260809 15:41:29.409862 29282 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39747
I20260809 15:41:29.410084 29282 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:29.410575 29282 heartbeater.cc:511] Master 127.14.15.190:39747 requested a full tablet report, sending...
I20260809 15:41:29.411096 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 29080
I20260809 15:41:29.411245 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:41:29.411568 14398 external_mini_cluster.cc:1428] Setting key b83d0c76b6fc9d0a44cd042467a72173
I20260809 15:41:29.411739 28816 ts_manager.cc:194] Registered new tserver with Master: 0969a5d7c1e74470b85f7f4833b52264 (127.14.15.130:34057)
I20260809 15:41:29.413430 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--builtin_ntp_servers=127.14.15.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 15:41:29.530787 29285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:29.531051 29285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:29.531092 29285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:29.535154 29285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:29.535208 29285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:29.535292 29285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:29.540128 29285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:29.541252 29285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:29.542936 29285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:29.552860 29303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.552907 29298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:29.552907 29294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:29.553045 29285 server_base.cc:1034] running on GCE node
I20260809 15:41:29.553505 29285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:29.554132 29285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:29.555334 29285 hybrid_clock.cc:648] HybridClock initialized: now 1786290089555298 us; error 54 us; skew 500 ppm
I20260809 15:41:29.557269 29285 webserver.cc:460] Webserver started at http://127.14.15.131:43777/ using document root <none> and password file <none>
I20260809 15:41:29.557873 29285 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:29.557971 29285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:29.558266 29285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:29.560890 29285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "6930bbc9e7e94c06bedff337041c371a"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "50ee2a30fc39227c0a79ee33fb84e03b"
server_key_iv: "bb2ee2c0b487b3457adceda712ebcc39"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.561489 29285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "6930bbc9e7e94c06bedff337041c371a"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "50ee2a30fc39227c0a79ee33fb84e03b"
server_key_iv: "bb2ee2c0b487b3457adceda712ebcc39"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.565733 29285 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:41:29.568475 29314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.569725 29285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:41:29.569865 29285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "6930bbc9e7e94c06bedff337041c371a"
format_stamp: "Formatted at 2026-08-09 15:41:29 on dist-test-slave-jztv"
server_key: "50ee2a30fc39227c0a79ee33fb84e03b"
server_key_iv: "bb2ee2c0b487b3457adceda712ebcc39"
server_key_version: "encryptionkey@0"
I20260809 15:41:29.569988 29285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:29.574704 29285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:29.575335 29285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:29.575523 29285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:29.576071 29285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:29.576995 29285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:29.577068 29285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.577133 29285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:29.577178 29285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:29.586288 29285 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45789
I20260809 15:41:29.586328 29486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45789 every 8 connection(s)
I20260809 15:41:29.587205 29285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:29.590953 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 29285
I20260809 15:41:29.591049 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:41:29.591324 14398 external_mini_cluster.cc:1428] Setting key 7ac4001ad61308562053c419d1aeca11
I20260809 15:41:29.593932 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.589191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:48337 (local address 127.14.15.190:39747)
0809 15:41:29.589362 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:29.589366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:29.590489 (+ 1123us) server_negotiation.cc:407] Connection header received
0809 15:41:29.591997 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:29.592000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:29.592052 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:29.592130 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:29.593390 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:29.593394 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:29.593396 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:41:29.593409 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:29.593430 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:41:29.593439 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:29.593543 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:29.593758 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 15:41:29.593803 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:41:29.594883 29489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:29.589619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39747 (local address 127.14.15.131:48337)
0809 15:41:29.590338 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:29.590379 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:29.591776 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:29.592355 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:29.592366 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:29.592478 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:29.593129 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:41:29.593131 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:29.593172 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:41:29.593241 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:29.593601 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:29.593610 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:29.593619 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:41:29.593795 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 15:41:29.594041 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":120,"threads_started":1}
I20260809 15:41:29.595993 29487 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39747
I20260809 15:41:29.596205 29487 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:29.596575 29487 heartbeater.cc:511] Master 127.14.15.190:39747 requested a full tablet report, sending...
I20260809 15:41:29.597613 28816 ts_manager.cc:194] Registered new tserver with Master: 6930bbc9e7e94c06bedff337041c371a (127.14.15.131:45789)
I20260809 15:41:29.605472 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:41:29.608500 28873 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:41:29.607628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39962 (local address 127.14.15.190:39747)
0809 15:41:29.607759 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:29.607763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:29.607919 (+ 156us) server_negotiation.cc:407] Connection header received
0809 15:41:29.608023 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:29.608025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:29.608058 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:29.608137 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:29.608341 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39962: BlockingRecv error: recv got EOF from 127.0.0.1:39962 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:41:29.608736 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28898
I20260809 15:41:29.626510 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 29080
I20260809 15:41:29.639168 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 29285
I20260809 15:41:29.656466 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 28764
2026-08-09T15:41:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (879 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:41:29 dist-test-slave-jztv krb5kdc[29498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:41:29 dist-test-slave-jztv krb5kdc[29498](info): set up 2 sockets
Aug 09 15:41:29 dist-test-slave-jztv krb5kdc[29498](info): commencing operation
krb5kdc: starting...
W20260809 15:41:30.906699 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:41:30 dist-test-slave-jztv krb5kdc[29498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:41:31.041391 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33239
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:31.157763 29518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:31.158098 29518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:31.158185 29518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:31.162252 29518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:41:31.162346 29518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:31.162385 29518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:31.162422 29518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:41:31.162451 29518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:41:31.167661 29518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:31.168726 29518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:31.169749 29518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:31.178295 29533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.178385 29528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.178580 29518 server_base.cc:1034] running on GCE node
W20260809 15:41:31.178381 29527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.179167 29518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:31.180325 29518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:31.181535 29518 hybrid_clock.cc:648] HybridClock initialized: now 1786290091181504 us; error 40 us; skew 500 ppm
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:31.184399 29518 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:41:31.185319 29518 webserver.cc:460] Webserver started at http://127.14.15.190:42105/ using document root <none> and password file <none>
I20260809 15:41:31.185846 29518 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:31.185906 29518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:31.186080 29518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:31.188218 29518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "8b198ac651d24fbf8ee0db6f242151cf"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "e3f9e090923cc114046b43dd853c1276"
server_key_iv: "f35c32c943815e95da4bbd9bbfd03313"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.188843 29518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "8b198ac651d24fbf8ee0db6f242151cf"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "e3f9e090923cc114046b43dd853c1276"
server_key_iv: "f35c32c943815e95da4bbd9bbfd03313"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.192833 29518 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 15:41:31.195271 29544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.196559 29518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:31.196683 29518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "8b198ac651d24fbf8ee0db6f242151cf"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "e3f9e090923cc114046b43dd853c1276"
server_key_iv: "f35c32c943815e95da4bbd9bbfd03313"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.196787 29518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:31.214592 29518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:31.217495 29518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:31.217660 29518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:31.224995 29518 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:33239
I20260809 15:41:31.225314 29617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:33239 every 8 connection(s)
I20260809 15:41:31.226024 29518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:41:31.228807 29618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:31.229239 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 29518
I20260809 15:41:31.229485 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:41:31.229781 14398 external_mini_cluster.cc:1428] Setting key c9d3cabab816eb3e2e4169f7af16385c
I20260809 15:41:31.235291 29618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: Bootstrap starting.
I20260809 15:41:31.237969 29618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:31.238840 29618 log.cc:824] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:31.240873 29618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: No bootstrap required, opened a new log
I20260809 15:41:31.244310 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:31.231227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50966 (local address 127.14.15.190:33239)
0809 15:41:31.231665 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:31.231688 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:31.231725 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:41:31.232358 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:31.232374 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:31.232710 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:31.232993 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:31.233949 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.235004 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.236124 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.236595 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.236714 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:31.239590 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:31.239597 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:31.239616 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:31.239653 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:31.241496 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.241990 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.241994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.241999 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.242108 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.242416 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.242418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.242420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.242798 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:31.242968 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:31.243295 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 15:41:31.243587 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":146,"threads_started":1}
I20260809 15:41:31.244944 29618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } }
I20260809 15:41:31.245195 29618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:31.245278 29618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b198ac651d24fbf8ee0db6f242151cf, State: Initialized, Role: FOLLOWER
I20260809 15:41:31.245745 29618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } }
I20260809 15:41:31.245915 29618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:41:31.245982 29618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:41:31.246074 29618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:31.247035 29618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } }
I20260809 15:41:31.247330 29618 leader_election.cc:302] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b198ac651d24fbf8ee0db6f242151cf; no voters:
I20260809 15:41:31.247586 29618 leader_election.cc:288] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:41:31.247709 29627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:31.247933 29627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [term 1 LEADER]: Becoming Leader. State: Replica: 8b198ac651d24fbf8ee0db6f242151cf, State: Running, Role: LEADER
I20260809 15:41:31.248306 29627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } }
I20260809 15:41:31.248849 29618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:41:31.250101 29628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b198ac651d24fbf8ee0db6f242151cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } } }
I20260809 15:41:31.250290 29628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:31.250093 29632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b198ac651d24fbf8ee0db6f242151cf. Latest consensus state: current_term: 1 leader_uuid: "8b198ac651d24fbf8ee0db6f242151cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b198ac651d24fbf8ee0db6f242151cf" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33239 } } }
I20260809 15:41:31.250599 29632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf [sys.catalog]: This master's current role is: LEADER
I20260809 15:41:31.251560 29646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:41:31.254132 29646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:41:31.259721 29646 catalog_manager.cc:1347] Generated new cluster ID: 4577ff6e4fcf42a3b269f2bebafee9d2
I20260809 15:41:31.259792 29646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:41:31.284961 29646 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:41:31.286403 29646 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:41:31.303750 29646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: Generated new TSK 0
I20260809 15:41:31.304594 29646 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:41:31.345643 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:31.473433 29665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:31.473723 29665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:31.473795 29665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:31.477834 29665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:31.477929 29665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:31.478020 29665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:41:31.483490 29665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:31.484565 29665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:31.485622 29665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:31.495249 29676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.495249 29672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.495651 29679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.495635 29665 server_base.cc:1034] running on GCE node
I20260809 15:41:31.496121 29665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:31.496743 29665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:31.497933 29665 hybrid_clock.cc:648] HybridClock initialized: now 1786290091497912 us; error 31 us; skew 500 ppm
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:31.507860 29665 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:41:31.508839 29665 webserver.cc:460] Webserver started at http://127.14.15.129:34575/ using document root <none> and password file <none>
I20260809 15:41:31.509438 29665 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:31.509510 29665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:31.509699 29665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:31.512024 29665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "1da508ef66624e5bb472a936924c2cc9"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "5d8bad5b4a1cb0619abfd3aa8c99ec53"
server_key_iv: "360cbff32f8e8c2020e4920fae19424f"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.512593 29665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "1da508ef66624e5bb472a936924c2cc9"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "5d8bad5b4a1cb0619abfd3aa8c99ec53"
server_key_iv: "360cbff32f8e8c2020e4920fae19424f"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.516978 29665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:41:31.519737 29690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.521117 29665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:41:31.521232 29665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "1da508ef66624e5bb472a936924c2cc9"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "5d8bad5b4a1cb0619abfd3aa8c99ec53"
server_key_iv: "360cbff32f8e8c2020e4920fae19424f"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.521337 29665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:31.539132 29665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:31.542972 29665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:31.543155 29665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:31.543831 29665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:31.544795 29665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:31.544850 29665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.544955 29665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:31.545001 29665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.555425 29665 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:41177
I20260809 15:41:31.555440 29874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:41177 every 8 connection(s)
I20260809 15:41:31.556365 29665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:41:31.563825 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 29665
I20260809 15:41:31.563993 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:41:31.564296 14398 external_mini_cluster.cc:1428] Setting key 77a1877160369a4bb095f980a6b3c679
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:31.571991 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:31.558304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:55427 (local address 127.14.15.190:33239)
0809 15:41:31.558456 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:31.558460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:31.559266 (+ 806us) server_negotiation.cc:407] Connection header received
0809 15:41:31.560731 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:31.560734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:31.560801 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:31.560906 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:31.562129 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.562744 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.563886 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.564229 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.564345 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:31.567694 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:31.567702 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:31.567708 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:31.567748 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:31.569499 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.570189 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.570191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.570193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.570343 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.570781 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.570783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.570784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.570974 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:31.571050 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:31.571752 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 15:41:31.571864 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:41:31.573333 29877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:31.558655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33239 (local address 127.14.15.129:55427)
0809 15:41:31.559110 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:31.559152 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:31.560496 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:31.561099 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:31.561105 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:31.561482 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:31.561971 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:31.561985 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.562878 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.562882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:31.563755 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:31.563764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.564389 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.564394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:31.564574 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:31.565310 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:31.565332 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:31.567491 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:31.569629 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:31.569639 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:31.569661 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:31.570079 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:31.570456 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:31.570463 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:31.570468 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:31.570679 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:31.571082 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:31.571092 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:31.571472 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 15:41:31.571716 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 15:41:31.572136 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":106,"threads_started":1}
I20260809 15:41:31.574797 29875 heartbeater.cc:347] Connected to a master server at 127.14.15.190:33239
I20260809 15:41:31.575065 29875 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:31.575603 29875 heartbeater.cc:511] Master 127.14.15.190:33239 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:41:31.577255 29565 ts_manager.cc:194] Registered new tserver with Master: 1da508ef66624e5bb472a936924c2cc9 (127.14.15.129:41177)
I20260809 15:41:31.578480 29565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:55427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:41:31.598482 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:31.711814 29880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:31.712110 29880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:31.712185 29880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:31.716147 29880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:31.716233 29880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:31.716320 29880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:41:31.721920 29880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:31.723045 29880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:31.724063 29880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:31.733764 29889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.733803 29887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.733783 29880 server_base.cc:1034] running on GCE node
W20260809 15:41:31.733772 29886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.734400 29880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:31.735016 29880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:31.736176 29880 hybrid_clock.cc:648] HybridClock initialized: now 1786290091736156 us; error 34 us; skew 500 ppm
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:31.738945 29880 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:41:31.739806 29880 webserver.cc:460] Webserver started at http://127.14.15.130:38501/ using document root <none> and password file <none>
I20260809 15:41:31.740374 29880 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:31.740440 29880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:31.740607 29880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:31.742646 29880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "25823bca9a7140e28698e8f42bc1ac83"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "740e04fae2e4ce4b020816828d735177"
server_key_iv: "6eee53f4532b5a3a719930fd93b859c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.743167 29880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "25823bca9a7140e28698e8f42bc1ac83"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "740e04fae2e4ce4b020816828d735177"
server_key_iv: "6eee53f4532b5a3a719930fd93b859c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.746747 29880 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:31.749171 29898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.750682 29880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:41:31.750778 29880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "25823bca9a7140e28698e8f42bc1ac83"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "740e04fae2e4ce4b020816828d735177"
server_key_iv: "6eee53f4532b5a3a719930fd93b859c7"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.750918 29880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:31.770409 29880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:31.773068 29880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:31.773226 29880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:31.773736 29880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:31.774616 29880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:31.774664 29880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.774705 29880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:31.774726 29880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.783773 29880 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:33825
I20260809 15:41:31.783802 30053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:33825 every 8 connection(s)
I20260809 15:41:31.784679 29880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:41:31.786309 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 29880
I20260809 15:41:31.786427 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:41:31.786790 14398 external_mini_cluster.cc:1428] Setting key 5e242ed0c8cee46128223ca8a7597b5d
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:41:31.800110 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:31.786657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:33053 (local address 127.14.15.190:33239)
0809 15:41:31.786841 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:31.786846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:31.787788 (+ 942us) server_negotiation.cc:407] Connection header received
0809 15:41:31.789316 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:31.789322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:31.789397 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:31.789491 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:31.790996 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.791515 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.793269 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.793473 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.793549 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:31.796468 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:31.796471 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:31.796474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:31.796500 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:31.797991 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.798573 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.798584 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.798586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.798670 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:31.799050 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:31.799053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:31.799054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:31.799249 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:31.799332 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:31.799877 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 15:41:31.799985 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 15:41:31.801100 30057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:31.787089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33239 (local address 127.14.15.130:33053)
0809 15:41:31.787622 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:31.787675 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:31.789090 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:31.789657 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:31.789664 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:31.790039 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:31.790747 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:31.790771 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.791648 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.791654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:31.793143 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:31.793158 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:31.793635 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:31.793642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:31.793874 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:31.794554 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:31.794580 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:31.796292 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:31.798114 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:31.798120 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:31.798136 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:31.798465 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:31.798771 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:31.798774 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:31.798776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:31.798915 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:31.799351 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:31.799356 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:31.799596 (+ 240us) client_negotiation.cc:769] Sending connection context
0809 15:41:31.799810 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 15:41:31.800098 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":130,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:41:31.802444 30055 heartbeater.cc:347] Connected to a master server at 127.14.15.190:33239
I20260809 15:41:31.802809 30055 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:31.803346 30055 heartbeater.cc:511] Master 127.14.15.190:33239 requested a full tablet report, sending...
I20260809 15:41:31.804474 29565 ts_manager.cc:194] Registered new tserver with Master: 25823bca9a7140e28698e8f42bc1ac83 (127.14.15.130:33825)
I20260809 15:41:31.805328 29565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:33053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:41:31.818918 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:41:31.941010 30063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:41:31.941308 30063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:41:31.941390 30063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:41:31.945501 30063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:41:31.945592 30063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:41:31.945683 30063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:41:31.951246 30063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:33239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:41:31.952435 30063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:41:31.953482 30063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:41:31.963336 30073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.963331 30069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:41:31.963331 30070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:41:31.963502 30063 server_base.cc:1034] running on GCE node
I20260809 15:41:31.963984 30063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:41:31.964658 30063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:41:31.965853 30063 hybrid_clock.cc:648] HybridClock initialized: now 1786290091965839 us; error 25 us; skew 500 ppm
Aug 09 15:41:31 dist-test-slave-jztv krb5kdc[29498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:41:31.968601 30063 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:41:31.969528 30063 webserver.cc:460] Webserver started at http://127.14.15.131:42753/ using document root <none> and password file <none>
I20260809 15:41:31.970118 30063 fs_manager.cc:359] Metadata directory not provided
I20260809 15:41:31.970217 30063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:41:31.970515 30063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:41:31.972512 30063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "58cc26f9e5eb4fdea7353dfc6f303412"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "a88be31b8abdd0c2e4db7eea888b4c91"
server_key_iv: "d43015302dc175a19bc9e36990264227"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.973030 30063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "58cc26f9e5eb4fdea7353dfc6f303412"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "a88be31b8abdd0c2e4db7eea888b4c91"
server_key_iv: "d43015302dc175a19bc9e36990264227"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.976855 30063 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 15:41:31.979418 30082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:31.980685 30063 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:41:31.980815 30063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "58cc26f9e5eb4fdea7353dfc6f303412"
format_stamp: "Formatted at 2026-08-09 15:41:31 on dist-test-slave-jztv"
server_key: "a88be31b8abdd0c2e4db7eea888b4c91"
server_key_iv: "d43015302dc175a19bc9e36990264227"
server_key_version: "encryptionkey@0"
I20260809 15:41:31.980930 30063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:41:32.001411 30063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:41:32.004875 30063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:41:32.005105 30063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:41:32.005728 30063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:41:32.006698 30063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:41:32.006749 30063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:32.006790 30063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:41:32.006844 30063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:41:32.015563 30063 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:38273
I20260809 15:41:32.015617 30250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:38273 every 8 connection(s)
I20260809 15:41:32.016577 30063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:41:32.026409 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 30063
I20260809 15:41:32.026568 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
Aug 09 15:41:32 dist-test-slave-jztv krb5kdc[29498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290091, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:41:32.026934 14398 external_mini_cluster.cc:1428] Setting key 82a1c931a097fae8cef154c0a2a166bb
I20260809 15:41:32.031427 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.018595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:43637 (local address 127.14.15.190:33239)
0809 15:41:32.018760 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.018764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.019603 (+ 839us) server_negotiation.cc:407] Connection header received
0809 15:41:32.021017 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.021021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.021070 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.021159 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:32.022345 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.022899 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.024017 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.024236 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.024325 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.027353 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:32.027357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:32.027360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:32.027392 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:32.029181 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:32.029778 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:32.029784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:32.029785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:32.029887 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:32.030265 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:32.030268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:32.030270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:32.030488 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:32.030605 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.031116 (+ 511us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.031255 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 15:41:32.032207 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.018933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33239 (local address 127.14.15.131:43637)
0809 15:41:32.019423 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.019477 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.020797 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.021321 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.021327 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.021680 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:41:32.022164 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.022178 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.023020 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.023023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.023897 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.023907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.024372 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.024374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.024567 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.025183 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:41:32.025200 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:41:32.027139 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:41:32.029288 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:32.029294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:32.029310 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:32.029669 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:32.029993 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:41:32.029996 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:41:32.029998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:41:32.030150 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:41:32.030605 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:41:32.030613 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:41:32.030870 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.031057 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.031397 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":138,"threads_started":1}
I20260809 15:41:32.033293 30251 heartbeater.cc:347] Connected to a master server at 127.14.15.190:33239
I20260809 15:41:32.033550 30251 heartbeater.cc:464] Registering TS with master...
I20260809 15:41:32.034014 30251 heartbeater.cc:511] Master 127.14.15.190:33239 requested a full tablet report, sending...
I20260809 15:41:32.035096 29565 ts_manager.cc:194] Registered new tserver with Master: 58cc26f9e5eb4fdea7353dfc6f303412 (127.14.15.131:38273)
I20260809 15:41:32.035647 29565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:43637
I20260809 15:41:32.041226 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:41:32.051573 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.043316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.14.15.190:33239)
0809 15:41:32.043502 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.043507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.043676 (+ 169us) server_negotiation.cc:407] Connection header received
0809 15:41:32.043838 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.043842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.043907 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.044002 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:41:32.045044 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.045633 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.046576 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.046798 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.046935 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.048286 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:41:32.048291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:41:32.048294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:41:32.048325 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:41:32.049752 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:32.050271 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:32.050274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:32.050276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:32.050365 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:41:32.050692 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:41:32.050695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:41:32.050696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:41:32.050911 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:41:32.051041 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.051242 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.051338 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:41:32.054677 29565 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:41:32.057685 29565 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:41:32.071933 30273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.066032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:33825 (local address 127.0.0.1:57482)
0809 15:41:32.066857 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.066872 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.066975 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.067876 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.067879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.067910 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:32.068009 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.068015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.068995 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.069000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.070454 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.070465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071362 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.071469 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071504 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.071645 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.071762 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":61,"thread_start_us":100,"threads_started":1}
I20260809 15:41:32.072156 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.066087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36720 (local address 127.14.15.131:38273)
0809 15:41:32.067134 (+ 1047us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.067143 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.067188 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:41:32.067265 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.067270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.067486 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.067709 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:32.068008 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.069197 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.070713 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071527 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071654 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071790 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.071889 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.071983 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":941,"thread_start_us":143,"threads_started":1}
I20260809 15:41:32.072530 30272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.066458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.14.15.130:33825)
0809 15:41:32.067260 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.067276 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.067302 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:41:32.067380 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.067386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.067590 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.067739 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:32.068131 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.068862 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.070587 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071234 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071361 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071511 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.072308 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.072407 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":108,"threads_started":1}
I20260809 15:41:32.072582 30275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.066499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.14.15.129:41177)
0809 15:41:32.066906 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.066935 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.067471 (+ 536us) server_negotiation.cc:407] Connection header received
0809 15:41:32.067545 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.067622 (+ 77us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.067805 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.067966 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:32.068381 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.069426 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.070808 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071576 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071668 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071790 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.072364 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.072475 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":98,"threads_started":1}
I20260809 15:41:32.072093 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.065949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:38273 (local address 127.0.0.1:36720)
0809 15:41:32.066745 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.066795 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.066944 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.067702 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.067708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.067730 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:32.067874 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.067881 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.069335 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.069338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.070567 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.070578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071657 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.071751 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071772 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.071846 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.071907 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":47,"thread_start_us":81,"threads_started":1}
I20260809 15:41:32.072266 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.066493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:41177 (local address 127.0.0.1:45712)
0809 15:41:32.067279 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.067292 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.067380 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.068136 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.068139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.068157 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:32.068248 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.068254 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.069549 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.069554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.070690 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.070701 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.071860 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.071864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.071952 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.071975 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.072048 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.072118 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260809 15:41:32.075981 29766 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7cb0d819ea4587950e1de816780084 (DEFAULT_TABLE table=test-table [id=3c4e136bc5e84038b923904ad7a6a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:32.075881 30150 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7cb0d819ea4587950e1de816780084 (DEFAULT_TABLE table=test-table [id=3c4e136bc5e84038b923904ad7a6a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:32.075881 29961 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7cb0d819ea4587950e1de816780084 (DEFAULT_TABLE table=test-table [id=3c4e136bc5e84038b923904ad7a6a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:41:32.076982 30150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7cb0d819ea4587950e1de816780084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:32.076978 29961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7cb0d819ea4587950e1de816780084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:32.076978 29766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7cb0d819ea4587950e1de816780084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:41:32.083117 30276 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: Bootstrap starting.
I20260809 15:41:32.084530 30277 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Bootstrap starting.
I20260809 15:41:32.085425 30276 tablet_bootstrap.cc:654] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:32.086326 30276 log.cc:824] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:32.086623 30279 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Bootstrap starting.
I20260809 15:41:32.086891 30277 tablet_bootstrap.cc:654] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:32.087760 30277 log.cc:824] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:32.088395 30276 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: No bootstrap required, opened a new log
I20260809 15:41:32.088620 30276 ts_tablet_manager.cc:1397] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:41:32.088804 30279 tablet_bootstrap.cc:654] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Neither blocks nor log segments found. Creating new log.
I20260809 15:41:32.089854 30277 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: No bootstrap required, opened a new log
I20260809 15:41:32.090041 30277 ts_tablet_manager.cc:1397] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:41:32.090039 30279 log.cc:824] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Log is configured to *not* fsync() on all Append() calls
I20260809 15:41:32.092036 30279 tablet_bootstrap.cc:492] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: No bootstrap required, opened a new log
I20260809 15:41:32.092242 30279 ts_tablet_manager.cc:1397] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:41:32.092449 30276 raft_consensus.cc:348] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.092693 30276 raft_consensus.cc:374] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:32.092767 30276 raft_consensus.cc:729] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da508ef66624e5bb472a936924c2cc9, State: Initialized, Role: FOLLOWER
I20260809 15:41:32.093235 30276 consensus_queue.cc:260] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.093901 29875 heartbeater.cc:503] Master 127.14.15.190:33239 was elected leader, sending a full tablet report...
I20260809 15:41:32.093814 30277 raft_consensus.cc:348] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.094046 30277 raft_consensus.cc:374] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:32.094117 30277 raft_consensus.cc:729] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25823bca9a7140e28698e8f42bc1ac83, State: Initialized, Role: FOLLOWER
I20260809 15:41:32.094594 30277 consensus_queue.cc:260] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.095598 30277 ts_tablet_manager.cc:1428] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:41:32.095602 30276 ts_tablet_manager.cc:1428] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 15:41:32.096011 30055 heartbeater.cc:503] Master 127.14.15.190:33239 was elected leader, sending a full tablet report...
I20260809 15:41:32.096118 30279 raft_consensus.cc:348] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.096369 30279 raft_consensus.cc:374] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:41:32.096441 30279 raft_consensus.cc:729] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58cc26f9e5eb4fdea7353dfc6f303412, State: Initialized, Role: FOLLOWER
I20260809 15:41:32.096894 30279 consensus_queue.cc:260] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.097553 30251 heartbeater.cc:503] Master 127.14.15.190:33239 was elected leader, sending a full tablet report...
I20260809 15:41:32.097899 30279 ts_tablet_manager.cc:1428] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:41:32.118484 30284 raft_consensus.cc:482] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:41:32.118716 30284 raft_consensus.cc:504] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.119879 30284 leader_election.cc:288] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58cc26f9e5eb4fdea7353dfc6f303412 (127.14.15.131:38273), 25823bca9a7140e28698e8f42bc1ac83 (127.14.15.130:33825)
I20260809 15:41:32.123930 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.120225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:35099 (local address 127.14.15.131:38273)
0809 15:41:32.120386 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.120391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.120634 (+ 243us) server_negotiation.cc:407] Connection header received
0809 15:41:32.120814 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.120816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.120863 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.120954 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:32.121259 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.121769 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.122890 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.123289 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.123434 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.123494 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.123745 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.123816 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 15:41:32.123968 30289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.120124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:38273 (local address 127.14.15.129:35099)
0809 15:41:32.120528 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.120541 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.120690 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.120968 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.120971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.120987 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:32.121145 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.121151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.121889 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.121893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.122758 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.122768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.123419 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.123423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.123555 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.123627 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.123713 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.123787 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":53,"thread_start_us":138,"threads_started":1}
I20260809 15:41:32.124012 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.120130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:33825 (local address 127.14.15.129:42005)
0809 15:41:32.120662 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.120674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:41:32.120805 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:41:32.121084 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:41:32.121087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:41:32.121104 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:41:32.121257 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.121262 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.121977 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.121982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.122835 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:41:32.122844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.123493 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.123496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:41:32.123684 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.123701 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:41:32.123792 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:41:32.123859 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":120,"thread_start_us":120,"threads_started":1}
I20260809 15:41:32.123991 30272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.120281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:42005 (local address 127.14.15.130:33825)
0809 15:41:32.120413 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.120417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.120773 (+ 356us) server_negotiation.cc:407] Connection header received
0809 15:41:32.120927 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.120930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.120984 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.121072 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:41:32.121375 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.121862 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.122968 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.123365 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.123500 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.123583 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.123811 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.123880 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:41:32.124624 29990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7cb0d819ea4587950e1de816780084" candidate_uuid: "1da508ef66624e5bb472a936924c2cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25823bca9a7140e28698e8f42bc1ac83" is_pre_election: true
I20260809 15:41:32.124625 30181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7cb0d819ea4587950e1de816780084" candidate_uuid: "1da508ef66624e5bb472a936924c2cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" is_pre_election: true
I20260809 15:41:32.124951 30181 raft_consensus.cc:2454] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da508ef66624e5bb472a936924c2cc9 in term 0.
I20260809 15:41:32.124951 29990 raft_consensus.cc:2454] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da508ef66624e5bb472a936924c2cc9 in term 0.
I20260809 15:41:32.125443 29691 leader_election.cc:302] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da508ef66624e5bb472a936924c2cc9, 58cc26f9e5eb4fdea7353dfc6f303412; no voters:
I20260809 15:41:32.125722 30284 raft_consensus.cc:2781] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:41:32.125809 30284 raft_consensus.cc:482] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:41:32.125854 30284 raft_consensus.cc:3037] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:32.127154 30284 raft_consensus.cc:504] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.127516 30284 leader_election.cc:288] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [CANDIDATE]: Term 1 election: Requested vote from peers 58cc26f9e5eb4fdea7353dfc6f303412 (127.14.15.131:38273), 25823bca9a7140e28698e8f42bc1ac83 (127.14.15.130:33825)
I20260809 15:41:32.127815 30181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7cb0d819ea4587950e1de816780084" candidate_uuid: "1da508ef66624e5bb472a936924c2cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc26f9e5eb4fdea7353dfc6f303412"
I20260809 15:41:32.127931 29990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7cb0d819ea4587950e1de816780084" candidate_uuid: "1da508ef66624e5bb472a936924c2cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25823bca9a7140e28698e8f42bc1ac83"
I20260809 15:41:32.127976 30181 raft_consensus.cc:3037] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:32.128094 29990 raft_consensus.cc:3037] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:41:32.129148 30181 raft_consensus.cc:2454] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da508ef66624e5bb472a936924c2cc9 in term 1.
I20260809 15:41:32.129181 29990 raft_consensus.cc:2454] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da508ef66624e5bb472a936924c2cc9 in term 1.
I20260809 15:41:32.129520 29698 leader_election.cc:302] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da508ef66624e5bb472a936924c2cc9, 25823bca9a7140e28698e8f42bc1ac83; no voters:
I20260809 15:41:32.129675 30284 raft_consensus.cc:2781] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:41:32.129915 30284 raft_consensus.cc:686] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [term 1 LEADER]: Becoming Leader. State: Replica: 1da508ef66624e5bb472a936924c2cc9, State: Running, Role: LEADER
I20260809 15:41:32.130311 30284 consensus_queue.cc:237] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } }
I20260809 15:41:32.133688 29565 catalog_manager.cc:5495] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da508ef66624e5bb472a936924c2cc9 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "1da508ef66624e5bb472a936924c2cc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da508ef66624e5bb472a936924c2cc9" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 41177 } health_report { overall_health: HEALTHY } } }
I20260809 15:41:32.150785 30275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.146961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.14.15.129:41177)
0809 15:41:32.147097 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:41:32.147100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:41:32.147118 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:41:32.147280 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:41:32.147283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:41:32.147336 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:41:32.147425 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:41:32.147695 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.148184 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.149116 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:41:32.149404 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:41:32.149565 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:41:32.149901 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:41:32.150421 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:41:32.150513 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:41:32.150591 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 15:41:32.150641 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:41:32.156797 30181 raft_consensus.cc:1261] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 1 FOLLOWER]: Refusing update from remote peer 1da508ef66624e5bb472a936924c2cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:32.156821 29990 raft_consensus.cc:1261] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 1 FOLLOWER]: Refusing update from remote peer 1da508ef66624e5bb472a936924c2cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:41:32.157554 30290 consensus_queue.cc:1035] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58cc26f9e5eb4fdea7353dfc6f303412" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:32.157753 30284 consensus_queue.cc:1035] T 1b7cb0d819ea4587950e1de816780084 P 1da508ef66624e5bb472a936924c2cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25823bca9a7140e28698e8f42bc1ac83" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 33825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:41:32.167814 30298 mvcc.cc:205] Tried to move back new op lower bound from 7316644217467052032 to 7316644217368604672. Current Snapshot: MvccSnapshot[applied={T|T < 7316644217467052032 or (T in {7316644217467052032})}]
I20260809 15:41:32.173807 29565 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:32.173986 29565 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:41:32.176461 29565 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b198ac651d24fbf8ee0db6f242151cf: Sending DeleteTablet for 3 replicas of tablet 1b7cb0d819ea4587950e1de816780084
I20260809 15:41:32.177217 29961 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7cb0d819ea4587950e1de816780084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:32 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:57482
I20260809 15:41:32.177217 29766 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7cb0d819ea4587950e1de816780084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:32 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:45712
I20260809 15:41:32.177740 30150 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7cb0d819ea4587950e1de816780084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:41:32 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:36720
I20260809 15:41:32.177827 30312 tablet_replica.cc:330] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: stopping tablet replica
I20260809 15:41:32.178297 30312 raft_consensus.cc:2229] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:32.178526 30314 tablet_replica.cc:330] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: stopping tablet replica
I20260809 15:41:32.178661 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 29665
I20260809 15:41:32.178829 30312 raft_consensus.cc:2258] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:32.178839 30314 raft_consensus.cc:2229] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:41:32.179119 30314 raft_consensus.cc:2258] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:41:32.180730 30314 ts_tablet_manager.cc:1905] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:32.183162 30312 ts_tablet_manager.cc:1905] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:41:32.184295 30314 ts_tablet_manager.cc:1918] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:32.184413 30314 log.cc:1196] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/1b7cb0d819ea4587950e1de816780084
I20260809 15:41:32.184775 30314 ts_tablet_manager.cc:1939] T 1b7cb0d819ea4587950e1de816780084 P 58cc26f9e5eb4fdea7353dfc6f303412: Deleting consensus metadata
I20260809 15:41:32.185890 30312 ts_tablet_manager.cc:1918] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:41:32.186019 30312 log.cc:1196] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/1b7cb0d819ea4587950e1de816780084
I20260809 15:41:32.186275 29545 catalog_manager.cc:4841] TS 58cc26f9e5eb4fdea7353dfc6f303412 (127.14.15.131:38273): tablet 1b7cb0d819ea4587950e1de816780084 (table test-table [id=3c4e136bc5e84038b923904ad7a6a56b]) successfully deleted
I20260809 15:41:32.186420 30312 ts_tablet_manager.cc:1939] T 1b7cb0d819ea4587950e1de816780084 P 25823bca9a7140e28698e8f42bc1ac83: Deleting consensus metadata
I20260809 15:41:32.187472 29548 catalog_manager.cc:4841] TS 25823bca9a7140e28698e8f42bc1ac83 (127.14.15.130:33825): tablet 1b7cb0d819ea4587950e1de816780084 (table test-table [id=3c4e136bc5e84038b923904ad7a6a56b]) successfully deleted
W20260809 15:41:32.190703 29547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:41177 (error 108)
I20260809 15:41:32.190872 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 29880
I20260809 15:41:32.196985 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:41:32.195628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:41177 (local address 127.0.0.1:45744)
0809 15:41:32.196772 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0809 15:41:32.196867 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:41177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1020}
W20260809 15:41:32.197201 29547 catalog_manager.cc:4584] TS 1da508ef66624e5bb472a936924c2cc9 (127.14.15.129:41177): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b7cb0d819ea4587950e1de816780084: Network error: Client connection negotiation failed: client connection to 127.14.15.129:41177: connect: Connection refused (error 111)
I20260809 15:41:32.202947 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 30063
I20260809 15:41:32.217337 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 29518
2026-08-09T15:41:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2559 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:41:32 dist-test-slave-jztv krb5kdc[30318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:41:32 dist-test-slave-jztv krb5kdc[30318](info): set up 2 sockets
Aug 09 15:41:32 dist-test-slave-jztv krb5kdc[30318](info): commencing operation
krb5kdc: starting...
W20260809 15:41:33.449231 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:41:33 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:41:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:41:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangeradmin_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangeradmin_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangerlookup_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangerlookup_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
I20260809 15:41:33.630347 14398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBoqIL5/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/postgres -l logfile start
2026-08-09 15:41:36.151 UTC [30361] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 15:41:36.151 UTC [30361] LOG: listening on IPv4 address "127.14.15.148", port 43615
2026-08-09 15:41:36.154 UTC [30361] LOG: listening on Unix socket "/tmp/.s.PGSQL.43615"
2026-08-09 15:41:36.177 UTC [30364] LOG: database system was shut down at 2026-08-09 15:41:34 UTC
2026-08-09 15:41:36.180 UTC [30361] LOG: database system is ready to accept connections
I20260809 15:41:37.331238 14398 mini_postgres.cc:96] Postgres bound to 43615
2026-08-09 15:41:37.339 UTC [30375] FATAL: database "slave" does not exist
127.14.15.148:43615 - accepting connections
I20260809 15:41:37.339958 14398 mini_ranger.cc:161] Starting Ranger...
I20260809 15:41:37.356734 14398 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 15:41:37.863070 14398 mini_ranger.cc:87] Created ranger Postgres database
I20260809 15:41:37.863157 14398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin
2026-08-09 15:41:38,139 [I] DB FLAVOR :POSTGRES
2026-08-09 15:41:38,140 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:41:38,140 [I] Checking connection..
2026-08-09 15:41:38,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 15:41:38,392 [I] Checking connection passed.
2026-08-09 15:41:38,392 [I] --------- Verifying version history table ---------
2026-08-09 15:41:38,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:41:38,663 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:41:38,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:41:38,917 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:41:38,918 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 15:41:38,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 15:41:39.193 UTC [30462] WARNING: there is no transaction in progress
2026-08-09 15:41:39,200 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 15:41:39,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:41:39,445 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 15:41:39,445 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:41:39,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 15:41:39,709 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 15:41:39,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jztv.c.gcp-upstream.internal','N') ;"
2026-08-09 15:41:40,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:41:40,462 [I] Table x_portal_user does not exist in database ranger
2026-08-09 15:41:40,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:41:40,718 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 15:41:40,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:41:40,955 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:41:41,221 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 15:41:41,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 15:41:42.184 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.202 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.219 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.235 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.255 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.273 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.336 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.343 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.358 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.368 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.378 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.392 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.402 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.409 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.416 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:42.422 UTC [30613] WARNING: there is no transaction in progress
2026-08-09 15:41:43,303 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 15:41:43,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 15:41:43,565 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 15:41:43,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:41:43,842 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 15:41:43,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:41:44,112 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 15:41:44,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:41:44,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:41:44,645 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jztv.c.gcp-upstream.internal';"
2026-08-09 15:41:44,904 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 15:41:44,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 15:41:45,151 [I] DB_PATCHES have already been applied
I20260809 15:41:45.157682 14398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBoqIL5/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 15:41:45.157748 14398 mini_ranger.cc:193] Using host: 127.14.15.148
I20260809 15:41:45.162171 14398 mini_ranger.cc:227] Ranger admin URL: http://127.14.15.148:54539
Aug 09, 2026 3:41:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:41:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:41:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:41:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:41:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:41:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:41:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 15:41:46.502041 14398 mini_ranger.cc:160] Time spent starting Ranger: real 9.162s user 0.003s sys 0.010s
Aug 09, 2026 3:42:07 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:42:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 3:42:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:42:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:42:08 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 15:42:09.232302 14398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangerkms_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/rangerkms_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.15.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.15.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 15:42:09 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290129, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 15:42:09.332855 14398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 15:42:09.345145 14398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 15:42:10.277143 14398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 15:42:10.277258 14398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms
I20260809 15:42:10.277381 14398 mini_ranger_kms.cc:227] Using postgres at 127.14.15.148:43615
2026-08-09 15:42:10,909 [I] DB FLAVOR :POSTGRES
2026-08-09 15:42:10,909 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:42:10,909 [I] Checking connection
2026-08-09 15:42:10,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 15:42:11,220 [I] connection success
2026-08-09 15:42:11,220 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 15:42:11,220 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 15:42:11,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 15:42:11,482 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 15:42:11,482 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:42:11,482 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 15:42:11,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:43615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 15:42:11,783 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 15:42:12.306192 14398 mini_ranger_kms.cc:310] Created kms service
I20260809 15:42:12.486974 14398 mini_ranger_kms.cc:326] Created kudu user
I20260809 15:42:12.537763 14398 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 15:42:12 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290129, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:12.977020 14398 mini_ranger_kms.cc:384] Added ranger policy
I20260809 15:42:12.977198 14398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 15:42:12.977232 14398 mini_ranger_kms.cc:240] Using host: 127.14.15.148
I20260809 15:42:12.982491 14398 mini_ranger_kms.cc:276] Ranger KMS PID: 30877
I20260809 15:42:12.982650 14398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.15.148:40519
Aug 09, 2026 3:42:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:42:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:42:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:42:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:42:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:42:15 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 15:42:15.829341 14398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.496s user 0.024s sys 0.584s
I20260809 15:42:15.829504 14398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 15:42:15.829658 14398 mini_ranger_kms.cc:401] 127.14.15.148:40519/kms/v1/keys
Aug 09 15:42:15 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786290135, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 15:42:16 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290135, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
Aug 09 15:42:16 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290135, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
Aug 09 15:42:19 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:42:19.300927 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41659
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:41659
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:40519/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:42:19.444831 30949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:42:19.445107 30949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:42:19.445196 30949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:42:19.449405 30949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:42:19.449474 30949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:42:19.449494 30949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:42:19.449510 30949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:42:19.449564 30949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:42:19.455264 30949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.15.148:40519/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:41659
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:42:19.456382 30949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:42:19.457428 30949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:42:19.466240 30960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:42:19.466348 30958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:42:19.466271 30957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:19.466569 30949 server_base.cc:1034] running on GCE node
I20260809 15:42:19.467164 30949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:42:19.468247 30949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:42:19.469467 30949 hybrid_clock.cc:648] HybridClock initialized: now 1786290139469444 us; error 36 us; skew 500 ppm
Aug 09 15:42:19 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290139, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:42:19.476333 30949 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:42:19.477294 30949 webserver.cc:460] Webserver started at http://127.14.15.190:35065/ using document root <none> and password file <none>
I20260809 15:42:19.477809 30949 fs_manager.cc:359] Metadata directory not provided
I20260809 15:42:19.477864 30949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:42:19.478047 30949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:42:19 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290139, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:19.527738 30949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894"
format_stamp: "Formatted at 2026-08-09 15:42:19 on dist-test-slave-jztv"
server_key: "ece1815ae4403df76168c838676cbf0b"
server_key_iv: "8e29a1a4f3f473e139f1004269e91ea2"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:19.528416 30949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894"
format_stamp: "Formatted at 2026-08-09 15:42:19 on dist-test-slave-jztv"
server_key: "ece1815ae4403df76168c838676cbf0b"
server_key_iv: "8e29a1a4f3f473e139f1004269e91ea2"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:19.532799 30949 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:42:19.547735 30969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:19.549271 30949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 15:42:19.549458 30949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894"
format_stamp: "Formatted at 2026-08-09 15:42:19 on dist-test-slave-jztv"
server_key: "ece1815ae4403df76168c838676cbf0b"
server_key_iv: "8e29a1a4f3f473e139f1004269e91ea2"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:19.549624 30949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:42:19.566329 30949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:42:19.569708 30949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:42:19.569963 30949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:42:19.583551 30949 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:41659
I20260809 15:42:19.583613 31046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:41659 every 8 connection(s)
I20260809 15:42:19.584666 30949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:42:19.587857 31047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:42:19.590577 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 30949
I20260809 15:42:19.590745 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:42:19.591122 14398 external_mini_cluster.cc:1428] Setting key c6cbab70ce6a17dd4b42e2124d469521
I20260809 15:42:19.595441 31047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: Bootstrap starting.
I20260809 15:42:19.598640 31047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: Neither blocks nor log segments found. Creating new log.
I20260809 15:42:19.600317 31047 log.cc:824] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: Log is configured to *not* fsync() on all Append() calls
I20260809 15:42:19.602984 31047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: No bootstrap required, opened a new log
Aug 09 15:42:19 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:42:19.608933 31047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } }
I20260809 15:42:19.609308 31047 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:42:19.609405 31047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bf8e57ef33e43f1a4eedb44bd6c1894, State: Initialized, Role: FOLLOWER
I20260809 15:42:19.609951 31047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } }
I20260809 15:42:19.610116 31047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:42:19.610266 31047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:42:19.610376 31047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:42:19.610888 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:19.592789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55154 (local address 127.14.15.190:41659)
0809 15:42:19.593332 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:19.593351 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:19.593398 (+ 47us) server_negotiation.cc:407] Connection header received
0809 15:42:19.594786 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:19.594815 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:19.595280 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:19.595762 (+ 482us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:42:19.596684 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:19.598597 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:19.600163 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:19.600974 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:19.601161 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:19.604608 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:42:19.604616 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:42:19.604636 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:42:19.604670 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:42:19.607041 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:19.607609 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:19.607626 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:19.607632 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:19.607870 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:19.608243 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:19.608246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:19.608259 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:19.608815 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:42:19.609047 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:19.609357 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 15:42:19.609783 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":160,"threads_started":1}
I20260809 15:42:19.611888 31047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } }
I20260809 15:42:19.612264 31047 leader_election.cc:302] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bf8e57ef33e43f1a4eedb44bd6c1894; no voters:
I20260809 15:42:19.612710 31047 leader_election.cc:288] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:42:19.612797 31053 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:42:19.613169 31053 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [term 1 LEADER]: Becoming Leader. State: Replica: 1bf8e57ef33e43f1a4eedb44bd6c1894, State: Running, Role: LEADER
I20260809 15:42:19.614255 31053 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } }
I20260809 15:42:19.614418 31047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:42:19.615759 31053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } } }
I20260809 15:42:19.615962 31053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [sys.catalog]: This master's current role is: LEADER
I20260809 15:42:19.616653 31064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:42:19.618518 31055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bf8e57ef33e43f1a4eedb44bd6c1894. Latest consensus state: current_term: 1 leader_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bf8e57ef33e43f1a4eedb44bd6c1894" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41659 } } }
I20260809 15:42:19.618675 31055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894 [sys.catalog]: This master's current role is: LEADER
I20260809 15:42:19.621049 31064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:42:19.621623 31047 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:42:19.635129 31064 catalog_manager.cc:1347] Generated new cluster ID: ae6f7c6328a84e308ff4753e093b7d74
I20260809 15:42:19.635321 31064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:42:19.661845 31064 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:42:19.663223 31064 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:42:19.668581 31064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: Generated new TSK 0
I20260809 15:42:19.669479 31064 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:42:20.578079 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:40519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:42:20.737418 31111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:42:20.737716 31111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:42:20.737810 31111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:42:20.742019 31111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:42:20.742101 31111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:42:20.742280 31111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:42:20.747913 31111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.15.148:40519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:42:20.749037 31111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:42:20.750079 31111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:42:20.760409 31121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:42:20.760370 31120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:20.760589 31111 server_base.cc:1034] running on GCE node
W20260809 15:42:20.760401 31126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:20.761219 31111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:42:20.762105 31111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:42:20.763403 31111 hybrid_clock.cc:648] HybridClock initialized: now 1786290140763380 us; error 37 us; skew 500 ppm
Aug 09 15:42:20 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:42:20.767553 31111 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:42:20.769074 31111 webserver.cc:460] Webserver started at http://127.14.15.129:45279/ using document root <none> and password file <none>
I20260809 15:42:20.769972 31111 fs_manager.cc:359] Metadata directory not provided
I20260809 15:42:20.770088 31111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:42:20.770491 31111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:42:20 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:20.790974 31111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "dd7cc828660048f69f747d208878f118"
format_stamp: "Formatted at 2026-08-09 15:42:20 on dist-test-slave-jztv"
server_key: "3f0919db7bb90a0f53646e2373b196b9"
server_key_iv: "93931a0ffcad0eba8db27c24ba81b9ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:20.791761 31111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "dd7cc828660048f69f747d208878f118"
format_stamp: "Formatted at 2026-08-09 15:42:20 on dist-test-slave-jztv"
server_key: "3f0919db7bb90a0f53646e2373b196b9"
server_key_iv: "93931a0ffcad0eba8db27c24ba81b9ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:20.796321 31111 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:42:20.830835 31133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:20.832782 31111 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.002s sys 0.000s
I20260809 15:42:20.832942 31111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "dd7cc828660048f69f747d208878f118"
format_stamp: "Formatted at 2026-08-09 15:42:20 on dist-test-slave-jztv"
server_key: "3f0919db7bb90a0f53646e2373b196b9"
server_key_iv: "93931a0ffcad0eba8db27c24ba81b9ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:20.833102 31111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:42:20.860930 31111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:42:20.867408 31111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:42:20.867693 31111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:42:20.868553 31111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:42:20.870203 31111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:42:20.870361 31111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 15:42:20.870590 31111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:42:20.870694 31111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:20.899782 31111 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:35783
I20260809 15:42:20.899858 31297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:35783 every 8 connection(s)
I20260809 15:42:20.901333 31111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:42:20.909655 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 31111
I20260809 15:42:20.909803 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:42:20.910132 14398 external_mini_cluster.cc:1428] Setting key 152333f151932025794e4409599bbc93
Aug 09 15:42:20 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:42:20.925146 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:20.903695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:35837 (local address 127.14.15.190:41659)
0809 15:42:20.904052 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:20.904056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:20.905202 (+ 1146us) server_negotiation.cc:407] Connection header received
0809 15:42:20.906581 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:20.906585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:20.906650 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:20.906833 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:42:20.908296 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:20.909256 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:20.914864 (+ 5608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:20.915293 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:20.915411 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:20.919831 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:42:20.919837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:42:20.919841 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:42:20.919875 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:42:20.922352 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:20.923103 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:20.923107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:20.923111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:20.923229 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:20.923700 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:20.923704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:20.923706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:20.923963 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:42:20.924057 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:20.924810 (+ 753us) server_negotiation.cc:299] Negotiation successful
0809 15:42:20.924954 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":160,"threads_started":1}
I20260809 15:42:20.926158 31302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:20.904198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41659 (local address 127.14.15.129:35837)
0809 15:42:20.904981 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:20.905037 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:20.906330 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:20.907017 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:20.907026 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:20.907431 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:42:20.908110 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:20.908130 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:20.910595 (+ 2465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:20.910599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:20.914705 (+ 4106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:20.914719 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:20.915722 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:20.915728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:20.916200 (+ 472us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:20.917034 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:42:20.917144 (+ 110us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:42:20.919590 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:42:20.922552 (+ 2962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:20.922560 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:20.922580 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:20.922962 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:20.923351 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:20.923354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:20.923356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:20.923567 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:20.924129 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:42:20.924136 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:42:20.924480 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 15:42:20.924701 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 15:42:20.925069 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":294,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:42:20.927807 31299 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41659
I20260809 15:42:20.928066 31299 heartbeater.cc:464] Registering TS with master...
I20260809 15:42:20.928692 31299 heartbeater.cc:511] Master 127.14.15.190:41659 requested a full tablet report, sending...
I20260809 15:42:20.931334 30997 ts_manager.cc:194] Registered new tserver with Master: dd7cc828660048f69f747d208878f118 (127.14.15.129:35783)
I20260809 15:42:20.932986 30997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:35837
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:42:20.955721 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:40519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:42:20 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 15:42:21.136296 31306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:42:21.136685 31306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:42:21.136754 31306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:42:21.143117 31306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:42:21.143205 31306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:42:21.143296 31306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:42:21.151358 31306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.15.148:40519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:42:21.152788 31306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:42:21.154351 31306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:42:21.168148 31320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:42:21.168262 31322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:21.168632 31306 server_base.cc:1034] running on GCE node
W20260809 15:42:21.168141 31318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:21.169575 31306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:42:21.170562 31306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:42:21.186285 31306 hybrid_clock.cc:648] HybridClock initialized: now 1786290141186135 us; error 123 us; skew 500 ppm
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:42:21.191459 31306 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:42:21.193059 31306 webserver.cc:460] Webserver started at http://127.14.15.130:41647/ using document root <none> and password file <none>
I20260809 15:42:21.193930 31306 fs_manager.cc:359] Metadata directory not provided
I20260809 15:42:21.194061 31306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:42:21.194482 31306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:21.213960 31306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "9203ddc4acdd4c0685a8381ac20c3451"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "ac2e902259c5e0c72f1f0f1491c66930"
server_key_iv: "5d4e43bc7ebebaed1ce987171af4dd79"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.215799 31306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "9203ddc4acdd4c0685a8381ac20c3451"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "ac2e902259c5e0c72f1f0f1491c66930"
server_key_iv: "5d4e43bc7ebebaed1ce987171af4dd79"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.222760 31306 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260809 15:42:21.243703 31332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:21.245493 31306 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260809 15:42:21.245664 31306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "9203ddc4acdd4c0685a8381ac20c3451"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "ac2e902259c5e0c72f1f0f1491c66930"
server_key_iv: "5d4e43bc7ebebaed1ce987171af4dd79"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.245818 31306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:42:21.262410 31306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:42:21.265964 31306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:42:21.266176 31306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:42:21.267006 31306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:42:21.268081 31306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:42:21.268157 31306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:21.268229 31306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:42:21.268276 31306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:21.289855 31306 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:40245
I20260809 15:42:21.289884 31502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:40245 every 8 connection(s)
I20260809 15:42:21.291062 31306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:42:21.299656 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 31306
I20260809 15:42:21.299816 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:42:21.300115 14398 external_mini_cluster.cc:1428] Setting key 8604ba0873efcaed0535253ebbec431a
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:42:21.310421 31505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.293604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41659 (local address 127.14.15.130:42963)
0809 15:42:21.294232 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:21.294289 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:21.295298 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:21.295883 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:21.295890 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:21.296308 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:42:21.296923 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.296959 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.297767 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.297770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.298817 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.298827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.299339 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.299344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.300762 (+ 1418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.301526 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:42:21.301551 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:42:21.304888 (+ 3337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:42:21.307185 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:21.307192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:21.307209 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:21.307488 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:21.307789 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:21.307792 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:21.307794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:21.307949 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:21.308433 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:42:21.308440 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:42:21.308765 (+ 325us) client_negotiation.cc:769] Sending connection context
0809 15:42:21.308980 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 15:42:21.309317 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":265,"threads_started":1}
I20260809 15:42:21.311184 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.293184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:42963 (local address 127.14.15.190:41659)
0809 15:42:21.293488 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.293502 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.294509 (+ 1007us) server_negotiation.cc:407] Connection header received
0809 15:42:21.295526 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.295530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.295591 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.295702 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:42:21.297098 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.297635 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.298951 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.299182 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.299298 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.305152 (+ 5854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:42:21.305157 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:42:21.305160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:42:21.305205 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:42:21.307054 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.307606 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.307615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.307616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.307691 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.308055 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.308059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.308060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.308284 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:42:21.308375 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.310848 (+ 2473us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.311003 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 15:42:21.313182 31503 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41659
I20260809 15:42:21.313431 31503 heartbeater.cc:464] Registering TS with master...
I20260809 15:42:21.314026 31503 heartbeater.cc:511] Master 127.14.15.190:41659 requested a full tablet report, sending...
I20260809 15:42:21.315261 30997 ts_manager.cc:194] Registered new tserver with Master: 9203ddc4acdd4c0685a8381ac20c3451 (127.14.15.130:40245)
I20260809 15:42:21.316043 30997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:42963
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:42:21.345335 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:40519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
W20260809 15:42:21.537150 31514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:42:21.537642 31514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:42:21.537772 31514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:42:21.544020 31514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:42:21.544199 31514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:42:21.544343 31514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:42:21.552789 31514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.15.148:40519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:41659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:42:21.554616 31514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:42:21.556059 31514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:42:21.572208 31524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:42:21.572831 31522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:21.574718 31514 server_base.cc:1034] running on GCE node
W20260809 15:42:21.578423 31527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:42:21.579077 31514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:42:21.580104 31514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:42:21.581270 31514 hybrid_clock.cc:648] HybridClock initialized: now 1786290141581241 us; error 63 us; skew 500 ppm
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:42:21.586001 31514 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:42:21.587400 31514 webserver.cc:460] Webserver started at http://127.14.15.131:40393/ using document root <none> and password file <none>
I20260809 15:42:21.588353 31514 fs_manager.cc:359] Metadata directory not provided
I20260809 15:42:21.588518 31514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:42:21.588858 31514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:21.623569 31514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "99ff9ff4e6d04c08aac12af9d6fde041"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "5a73731ad62f5e9acbdfdb50280c4126"
server_key_iv: "e3773e89d0b9a60ba829abf25a7db828"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.624607 31514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "99ff9ff4e6d04c08aac12af9d6fde041"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "5a73731ad62f5e9acbdfdb50280c4126"
server_key_iv: "e3773e89d0b9a60ba829abf25a7db828"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.631835 31514 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 15:42:21.652753 31535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:21.654722 31514 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260809 15:42:21.654934 31514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "99ff9ff4e6d04c08aac12af9d6fde041"
format_stamp: "Formatted at 2026-08-09 15:42:21 on dist-test-slave-jztv"
server_key: "5a73731ad62f5e9acbdfdb50280c4126"
server_key_iv: "e3773e89d0b9a60ba829abf25a7db828"
server_key_version: "kuduclusterkey@0"
I20260809 15:42:21.655160 31514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:42:21.686549 31514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:42:21.692732 31514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:42:21.693172 31514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:42:21.694713 31514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:42:21.696640 31514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:42:21.696782 31514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 15:42:21.696961 31514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:42:21.697098 31514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:42:21.725868 31514 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:35593
I20260809 15:42:21.727283 31514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:42:21.730499 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 31514
I20260809 15:42:21.730646 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:42:21.730984 14398 external_mini_cluster.cc:1428] Setting key 70595930fc0574b0e1f5f17a02266b0c
I20260809 15:42:21.736248 31690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:35593 every 8 connection(s)
Aug 09 15:42:21 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:42:21.772321 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.741403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:34291 (local address 127.14.15.190:41659)
0809 15:42:21.741533 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.741538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.747133 (+ 5595us) server_negotiation.cc:407] Connection header received
0809 15:42:21.750143 (+ 3010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.750147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.750209 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.750296 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:42:21.752546 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.753514 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.762979 (+ 9465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.763378 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.763487 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.767607 (+ 4120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:42:21.767612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:42:21.767615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:42:21.767648 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:42:21.769684 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.770429 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.770433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.770435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.770531 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.770966 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.770969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.770972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.771204 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:42:21.771289 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.772021 (+ 732us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.772151 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:42:21.774178 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.739796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41659 (local address 127.14.15.131:34291)
0809 15:42:21.746718 (+ 6922us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:21.746796 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:21.749854 (+ 3058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:21.750795 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:21.750805 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:21.751431 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:42:21.752329 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.752353 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.753695 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.753698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.762783 (+ 9085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.762802 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.763738 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.763743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.764021 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.764985 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:42:21.765009 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:42:21.767357 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:42:21.769850 (+ 2493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:21.769857 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:21.769875 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:21.770285 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:21.770649 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:42:21.770652 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:42:21.770655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:42:21.770844 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:42:21.771362 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:42:21.771369 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:42:21.771717 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 15:42:21.772641 (+ 924us) client_negotiation.cc:240] Negotiation successful
0809 15:42:21.773017 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6574,"thread_start_us":392,"threads_started":1}
I20260809 15:42:21.775935 31693 heartbeater.cc:347] Connected to a master server at 127.14.15.190:41659
I20260809 15:42:21.776211 31693 heartbeater.cc:464] Registering TS with master...
I20260809 15:42:21.776839 31693 heartbeater.cc:511] Master 127.14.15.190:41659 requested a full tablet report, sending...
I20260809 15:42:21.778095 30997 ts_manager.cc:194] Registered new tserver with Master: 99ff9ff4e6d04c08aac12af9d6fde041 (127.14.15.131:35593)
I20260809 15:42:21.778972 30997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:34291
I20260809 15:42:21.781639 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:42:21.806107 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.790753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.14.15.190:41659)
0809 15:42:21.790875 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.790880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.795965 (+ 5085us) server_negotiation.cc:407] Connection header received
0809 15:42:21.796215 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.796219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.796277 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.796335 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:42:21.797565 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.798410 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.799672 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.800016 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.800101 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.802172 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:42:21.802177 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:42:21.802180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:42:21.802238 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:42:21.804040 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.804596 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.804600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.804603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.804696 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:42:21.805011 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:42:21.805015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:42:21.805017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:42:21.805263 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:42:21.805384 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.805794 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.805929 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:42:21.810081 30997 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:42:21.814857 30997 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:42:21.873350 31717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.846575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40245 (local address 127.0.0.1:38520)
0809 15:42:21.858818 (+ 12243us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:21.858832 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:21.859036 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:21.860166 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:21.860173 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:21.860199 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:42:21.860341 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.860349 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.863099 (+ 2750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.863102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.864533 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.864546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.872766 (+ 8220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.872769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.872895 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.872937 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 15:42:21.873061 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:42:21.873186 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12178,"thread_start_us":198,"threads_started":1}
I20260809 15:42:21.874548 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.848192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:35783 (local address 127.0.0.1:46318)
0809 15:42:21.864772 (+ 16580us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:21.864785 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:21.865096 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:21.866827 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:21.866830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:21.866848 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:42:21.866981 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.866988 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.868317 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.868321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.869531 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.869542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.874065 (+ 4523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.874069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.874244 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.874270 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:42:21.874341 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 15:42:21.874409 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16514,"thread_start_us":145,"threads_started":1}
I20260809 15:42:21.875068 31719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.848545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.14.15.129:35783)
0809 15:42:21.859298 (+ 10753us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.859304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.865204 (+ 5900us) server_negotiation.cc:407] Connection header received
0809 15:42:21.865292 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.865298 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.866331 (+ 1033us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.866672 (+ 341us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:42:21.867120 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.868186 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.869673 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.870558 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.870660 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.870821 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.874812 (+ 3991us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.874925 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10631,"thread_start_us":186,"threads_started":1}
I20260809 15:42:21.875546 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.847501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38520 (local address 127.14.15.130:40245)
0809 15:42:21.858641 (+ 11140us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.858649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.859355 (+ 706us) server_negotiation.cc:407] Connection header received
0809 15:42:21.859469 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.859474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.859711 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.859960 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:42:21.861628 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.862947 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.870888 (+ 7941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.872466 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.872571 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.872699 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.875305 (+ 2606us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.875412 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11018,"thread_start_us":190,"threads_started":1}
I20260809 15:42:21.882012 31411 tablet_service.cc:1467] Processing CreateTablet for tablet cb305c954e63496b8436f07e1560cc1b (DEFAULT_TABLE table=test-table [id=a6e065db3e564bc088d5f761fd026b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:42:21.882546 31195 tablet_service.cc:1467] Processing CreateTablet for tablet cb305c954e63496b8436f07e1560cc1b (DEFAULT_TABLE table=test-table [id=a6e065db3e564bc088d5f761fd026b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:42:21.883490 31411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb305c954e63496b8436f07e1560cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:42:21.883706 31195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb305c954e63496b8436f07e1560cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:42:21.906548 31715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.845925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:35593 (local address 127.0.0.1:43542)
0809 15:42:21.858081 (+ 12156us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:21.858152 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:21.858314 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:21.895116 (+ 36802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:21.895121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:21.895154 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:42:21.895287 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.895293 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.903200 (+ 7907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.903204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.904682 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:21.904701 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.906066 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.906070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:21.906186 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.906247 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 15:42:21.906304 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 15:42:21.906391 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11905,"thread_start_us":2026,"threads_started":1}
I20260809 15:42:21.907630 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:21.846138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43542 (local address 127.14.15.131:35593)
0809 15:42:21.875952 (+ 29814us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:21.875970 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:21.876004 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:42:21.876085 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:21.876091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:21.876316 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:21.895474 (+ 19158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:42:21.895637 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.902998 (+ 7361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.904959 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:21.905819 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:21.907173 (+ 1354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:21.907339 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:21.907393 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 15:42:21.907490 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29691,"thread_start_us":230,"threads_started":1}
I20260809 15:42:21.908219 31722 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: Bootstrap starting.
I20260809 15:42:21.910632 31723 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Bootstrap starting.
I20260809 15:42:21.913214 31722 tablet_bootstrap.cc:654] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: Neither blocks nor log segments found. Creating new log.
I20260809 15:42:21.913550 31723 tablet_bootstrap.cc:654] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Neither blocks nor log segments found. Creating new log.
I20260809 15:42:21.913641 31603 tablet_service.cc:1467] Processing CreateTablet for tablet cb305c954e63496b8436f07e1560cc1b (DEFAULT_TABLE table=test-table [id=a6e065db3e564bc088d5f761fd026b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:42:21.915165 31603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb305c954e63496b8436f07e1560cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:42:21.915221 31722 log.cc:824] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: Log is configured to *not* fsync() on all Append() calls
I20260809 15:42:21.919350 31723 log.cc:824] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Log is configured to *not* fsync() on all Append() calls
I20260809 15:42:21.932704 31723 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: No bootstrap required, opened a new log
I20260809 15:42:21.933115 31723 ts_tablet_manager.cc:1397] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260809 15:42:21.936362 31299 heartbeater.cc:503] Master 127.14.15.190:41659 was elected leader, sending a full tablet report...
I20260809 15:42:21.938687 31726 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Bootstrap starting.
I20260809 15:42:21.939332 31723 raft_consensus.cc:348] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.939663 31723 raft_consensus.cc:374] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:42:21.939711 31723 raft_consensus.cc:729] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9203ddc4acdd4c0685a8381ac20c3451, State: Initialized, Role: FOLLOWER
I20260809 15:42:21.942256 31726 tablet_bootstrap.cc:654] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Neither blocks nor log segments found. Creating new log.
I20260809 15:42:21.944061 31726 log.cc:824] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Log is configured to *not* fsync() on all Append() calls
I20260809 15:42:21.944748 31722 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: No bootstrap required, opened a new log
I20260809 15:42:21.945055 31722 ts_tablet_manager.cc:1397] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.007s
I20260809 15:42:21.950452 31723 consensus_queue.cc:260] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.952276 31723 ts_tablet_manager.cc:1428] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Time spent starting tablet: real 0.019s user 0.003s sys 0.005s
I20260809 15:42:21.952782 31503 heartbeater.cc:503] Master 127.14.15.190:41659 was elected leader, sending a full tablet report...
I20260809 15:42:21.953171 31722 raft_consensus.cc:348] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.953524 31722 raft_consensus.cc:374] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:42:21.953578 31722 raft_consensus.cc:729] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd7cc828660048f69f747d208878f118, State: Initialized, Role: FOLLOWER
I20260809 15:42:21.954845 31726 tablet_bootstrap.cc:492] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: No bootstrap required, opened a new log
I20260809 15:42:21.955134 31726 ts_tablet_manager.cc:1397] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.000s
I20260809 15:42:21.954685 31722 consensus_queue.cc:260] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.959780 31722 ts_tablet_manager.cc:1428] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20260809 15:42:21.959569 31726 raft_consensus.cc:348] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.959872 31726 raft_consensus.cc:374] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:42:21.959969 31726 raft_consensus.cc:729] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ff9ff4e6d04c08aac12af9d6fde041, State: Initialized, Role: FOLLOWER
I20260809 15:42:21.960538 31726 consensus_queue.cc:260] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:21.961959 31726 ts_tablet_manager.cc:1428] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:42:21.962459 31693 heartbeater.cc:503] Master 127.14.15.190:41659 was elected leader, sending a full tablet report...
W20260809 15:42:21.988704 31696 tablet.cc:2369] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:42:22.011919 31732 raft_consensus.cc:482] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:42:22.012182 31732 raft_consensus.cc:504] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:22.013688 31732 leader_election.cc:288] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ff9ff4e6d04c08aac12af9d6fde041 (127.14.15.131:35593), 9203ddc4acdd4c0685a8381ac20c3451 (127.14.15.130:40245)
Aug 09 15:42:22 dist-test-slave-jztv krb5kdc[30318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290140, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:42:22.022419 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.014410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:55659 (local address 127.14.15.131:35593)
0809 15:42:22.014575 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:22.014580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:22.016979 (+ 2399us) server_negotiation.cc:407] Connection header received
0809 15:42:22.017276 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:22.017279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:22.017333 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:22.017425 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:42:22.018072 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.018909 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.020939 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.021567 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.021668 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:22.021726 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:22.022173 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 15:42:22.022278 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:42:22.023123 31737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.014121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:35593 (local address 127.14.15.129:55659)
0809 15:42:22.016801 (+ 2680us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:22.016816 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:22.017043 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:22.017576 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:22.017580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:22.017603 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:42:22.017919 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:22.017929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.019204 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.019208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:22.020783 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:22.020796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.021870 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.021873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:22.022016 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:22.022044 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:42:22.022859 (+ 815us) client_negotiation.cc:240] Negotiation successful
0809 15:42:22.022947 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2603,"thread_start_us":261,"threads_started":1}
I20260809 15:42:22.024060 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb305c954e63496b8436f07e1560cc1b" candidate_uuid: "dd7cc828660048f69f747d208878f118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" is_pre_election: true
I20260809 15:42:22.024456 31610 raft_consensus.cc:2454] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd7cc828660048f69f747d208878f118 in term 0.
I20260809 15:42:22.025264 31135 leader_election.cc:302] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ff9ff4e6d04c08aac12af9d6fde041, dd7cc828660048f69f747d208878f118; no voters:
I20260809 15:42:22.025645 31732 raft_consensus.cc:2781] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:42:22.025722 31732 raft_consensus.cc:482] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:42:22.025758 31732 raft_consensus.cc:3037] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:42:22.027915 31732 raft_consensus.cc:504] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:22.028318 31732 leader_election.cc:288] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [CANDIDATE]: Term 1 election: Requested vote from peers 99ff9ff4e6d04c08aac12af9d6fde041 (127.14.15.131:35593), 9203ddc4acdd4c0685a8381ac20c3451 (127.14.15.130:40245)
I20260809 15:42:22.028990 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb305c954e63496b8436f07e1560cc1b" candidate_uuid: "dd7cc828660048f69f747d208878f118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ff9ff4e6d04c08aac12af9d6fde041"
I20260809 15:42:22.029117 31610 raft_consensus.cc:3037] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:42:22.030777 31610 raft_consensus.cc:2454] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd7cc828660048f69f747d208878f118 in term 1.
I20260809 15:42:22.031198 31135 leader_election.cc:302] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ff9ff4e6d04c08aac12af9d6fde041, dd7cc828660048f69f747d208878f118; no voters:
I20260809 15:42:22.031431 31732 raft_consensus.cc:2781] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:42:22.031790 31732 raft_consensus.cc:686] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [term 1 LEADER]: Becoming Leader. State: Replica: dd7cc828660048f69f747d208878f118, State: Running, Role: LEADER
I20260809 15:42:22.032173 31732 consensus_queue.cc:237] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } }
I20260809 15:42:22.032792 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.015343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41061 (local address 127.14.15.130:40245)
0809 15:42:22.015458 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:22.015462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:22.022794 (+ 7332us) server_negotiation.cc:407] Connection header received
0809 15:42:22.023010 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:22.023014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:22.023068 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:22.023116 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:42:22.023537 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.024273 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.031325 (+ 7052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.032009 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.032112 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:22.032166 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:22.032550 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 15:42:22.032644 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:42:22.033303 31735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.014720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40245 (local address 127.14.15.129:41061)
0809 15:42:22.022524 (+ 7804us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:22.022541 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:42:22.022883 (+ 342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:42:22.023253 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:42:22.023256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:42:22.023273 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:42:22.023400 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:22.023406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.024438 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.024442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:22.031136 (+ 6694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:42:22.031152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.032273 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.032276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:42:22.032396 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:22.032422 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:42:22.033072 (+ 650us) client_negotiation.cc:240] Negotiation successful
0809 15:42:22.033158 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7724,"thread_start_us":194,"threads_started":1}
I20260809 15:42:22.034235 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb305c954e63496b8436f07e1560cc1b" candidate_uuid: "dd7cc828660048f69f747d208878f118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9203ddc4acdd4c0685a8381ac20c3451" is_pre_election: true
I20260809 15:42:22.034540 31438 raft_consensus.cc:2454] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd7cc828660048f69f747d208878f118 in term 0.
I20260809 15:42:22.034999 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb305c954e63496b8436f07e1560cc1b" candidate_uuid: "dd7cc828660048f69f747d208878f118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9203ddc4acdd4c0685a8381ac20c3451"
I20260809 15:42:22.035120 31437 raft_consensus.cc:3037] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:42:22.036755 31437 raft_consensus.cc:2454] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd7cc828660048f69f747d208878f118 in term 1.
I20260809 15:42:22.040500 30997 catalog_manager.cc:5495] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd7cc828660048f69f747d208878f118 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "dd7cc828660048f69f747d208878f118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd7cc828660048f69f747d208878f118" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 } health_report { overall_health: UNKNOWN } } }
W20260809 15:42:22.046885 31504 tablet.cc:2369] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:42:22.098002 31719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.093089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46322 (local address 127.14.15.129:35783)
0809 15:42:22.093248 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:42:22.093255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:42:22.093289 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:42:22.093381 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:42:22.093384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:42:22.093451 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:42:22.093575 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:42:22.093958 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.094782 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.096007 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:42:22.096263 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:42:22.096390 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:42:22.096793 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:42:22.097434 (+ 641us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:42:22.097597 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 15:42:22.097645 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 15:42:22.097714 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:42:22.120528 31610 raft_consensus.cc:1261] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 1 FOLLOWER]: Refusing update from remote peer dd7cc828660048f69f747d208878f118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:42:22.121471 31437 raft_consensus.cc:1261] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 1 FOLLOWER]: Refusing update from remote peer dd7cc828660048f69f747d208878f118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:42:22.122244 31738 consensus_queue.cc:1035] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9203ddc4acdd4c0685a8381ac20c3451" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:42:22.123310 31738 consensus_queue.cc:1035] T cb305c954e63496b8436f07e1560cc1b P dd7cc828660048f69f747d208878f118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ff9ff4e6d04c08aac12af9d6fde041" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 35593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:42:22.162324 31746 mvcc.cc:205] Tried to move back new op lower bound from 7316644422110302208 to 7316644421767569408. Current Snapshot: MvccSnapshot[applied={T|T < 7316644422110302208}]
I20260809 15:42:22.166524 31748 mvcc.cc:205] Tried to move back new op lower bound from 7316644422110302208 to 7316644421767569408. Current Snapshot: MvccSnapshot[applied={T|T < 7316644422110302208}]
I20260809 15:42:22.180397 30997 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:42:22.180648 30997 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:42:22.184028 30997 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1bf8e57ef33e43f1a4eedb44bd6c1894: Sending DeleteTablet for 3 replicas of tablet cb305c954e63496b8436f07e1560cc1b
I20260809 15:42:22.186257 31603 tablet_service.cc:1514] Processing DeleteTablet for tablet cb305c954e63496b8436f07e1560cc1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:42:22 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:43542
I20260809 15:42:22.186959 31195 tablet_service.cc:1514] Processing DeleteTablet for tablet cb305c954e63496b8436f07e1560cc1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:42:22 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46318
I20260809 15:42:22.187711 31411 tablet_service.cc:1514] Processing DeleteTablet for tablet cb305c954e63496b8436f07e1560cc1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:42:22 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:38520
I20260809 15:42:22.189154 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 31111
I20260809 15:42:22.210470 31757 tablet_replica.cc:330] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: stopping tablet replica
I20260809 15:42:22.210834 31755 tablet_replica.cc:330] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: stopping tablet replica
I20260809 15:42:22.211338 31755 raft_consensus.cc:2229] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:42:22.211745 31757 raft_consensus.cc:2229] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:42:22.212229 31757 raft_consensus.cc:2258] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:42:22.212594 31755 raft_consensus.cc:2258] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:42:22.215308 31757 ts_tablet_manager.cc:1905] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:42:22.216820 31755 ts_tablet_manager.cc:1905] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:42:22.218477 31757 ts_tablet_manager.cc:1918] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:42:22.218672 31757 log.cc:1196] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/cb305c954e63496b8436f07e1560cc1b
I20260809 15:42:22.219085 31757 ts_tablet_manager.cc:1939] T cb305c954e63496b8436f07e1560cc1b P 9203ddc4acdd4c0685a8381ac20c3451: Deleting consensus metadata
I20260809 15:42:22.219885 31755 ts_tablet_manager.cc:1918] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:42:22.219988 31755 log.cc:1196] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/cb305c954e63496b8436f07e1560cc1b
I20260809 15:42:22.220302 31755 ts_tablet_manager.cc:1939] T cb305c954e63496b8436f07e1560cc1b P 99ff9ff4e6d04c08aac12af9d6fde041: Deleting consensus metadata
I20260809 15:42:22.220881 30972 catalog_manager.cc:4841] TS 9203ddc4acdd4c0685a8381ac20c3451 (127.14.15.130:40245): tablet cb305c954e63496b8436f07e1560cc1b (table test-table [id=a6e065db3e564bc088d5f761fd026b73]) successfully deleted
I20260809 15:42:22.221575 30971 catalog_manager.cc:4841] TS 99ff9ff4e6d04c08aac12af9d6fde041 (127.14.15.131:35593): tablet cb305c954e63496b8436f07e1560cc1b (table test-table [id=a6e065db3e564bc088d5f761fd026b73]) successfully deleted
W20260809 15:42:22.221938 30971 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:35783 (error 108)
I20260809 15:42:22.223867 31715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:42:22.223546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:35783 (local address 127.0.0.1:46330)
0809 15:42:22.223721 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 15:42:22.223785 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:35783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260809 15:42:22.224128 30971 catalog_manager.cc:4584] TS dd7cc828660048f69f747d208878f118 (127.14.15.129:35783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb305c954e63496b8436f07e1560cc1b: Network error: Client connection negotiation failed: client connection to 127.14.15.129:35783: connect: Connection refused (error 111)
I20260809 15:42:22.224526 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 31306
I20260809 15:42:22.237994 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 31514
I20260809 15:42:22.249858 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 30949
I20260809 15:42:22.259840 14398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 15:42:22.614753 14398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 15:42:22.614918 14398 mini_ranger.cc:66] Stopping Ranger...
I20260809 15:42:22.960073 14398 mini_ranger.cc:68] Stopped Ranger
2026-08-09 15:42:22.960 UTC [30361] LOG: received smart shutdown request
2026-08-09 15:42:22.964 UTC [30361] LOG: background worker "logical replication launcher" (PID 30373) exited with exit code 1
2026-08-09 15:42:22.964 UTC [30365] LOG: shutting down
2026-08-09 15:42:23.146 UTC [30361] LOG: database system is shut down
2026-08-09T15:42:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51044 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:42:23 dist-test-slave-jztv krb5kdc[31773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:42:23 dist-test-slave-jztv krb5kdc[31773](info): set up 2 sockets
Aug 09 15:42:23 dist-test-slave-jztv krb5kdc[31773](info): commencing operation
krb5kdc: starting...
W20260809 15:42:24.535135 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:42:24 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:42:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:42:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangeradmin_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangeradmin_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangerlookup_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangerlookup_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
I20260809 15:42:24.733788 14398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBoqIL5/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/postgres -l logfile start
2026-08-09 15:42:27.347 UTC [31821] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 15:42:27.347 UTC [31821] LOG: listening on IPv4 address "127.14.15.148", port 51601
2026-08-09 15:42:27.351 UTC [31821] LOG: listening on Unix socket "/tmp/.s.PGSQL.51601"
2026-08-09 15:42:27.373 UTC [31824] LOG: database system was shut down at 2026-08-09 15:42:25 UTC
2026-08-09 15:42:27.377 UTC [31821] LOG: database system is ready to accept connections
I20260809 15:42:28.516906 14398 mini_postgres.cc:96] Postgres bound to 51601
2026-08-09 15:42:28.525 UTC [31835] FATAL: database "slave" does not exist
127.14.15.148:51601 - accepting connections
I20260809 15:42:28.526015 14398 mini_ranger.cc:161] Starting Ranger...
I20260809 15:42:28.547467 14398 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 15:42:29.010923 14398 mini_ranger.cc:87] Created ranger Postgres database
I20260809 15:42:29.011034 14398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin
2026-08-09 15:42:29,291 [I] DB FLAVOR :POSTGRES
2026-08-09 15:42:29,292 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:42:29,292 [I] Checking connection..
2026-08-09 15:42:29,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 15:42:29,553 [I] Checking connection passed.
2026-08-09 15:42:29,554 [I] --------- Verifying version history table ---------
2026-08-09 15:42:29,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:42:29,828 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:42:29,829 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:42:30,086 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:42:30,086 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 15:42:30,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 15:42:30.343 UTC [31924] WARNING: there is no transaction in progress
2026-08-09 15:42:30,352 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 15:42:30,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:42:30,616 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 15:42:30,616 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:42:30,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 15:42:30,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 15:42:31,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jztv.c.gcp-upstream.internal','N') ;"
2026-08-09 15:42:31,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:42:31,665 [I] Table x_portal_user does not exist in database ranger
2026-08-09 15:42:31,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:42:31,925 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 15:42:31,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:42:32,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:42:32,428 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 15:42:32,428 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 15:42:33.410 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.427 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.444 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.461 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.477 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.495 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.552 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.559 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.573 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.583 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.594 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.609 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.619 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.626 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.633 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:33.639 UTC [32076] WARNING: there is no transaction in progress
2026-08-09 15:42:34,323 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 15:42:34,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 15:42:34,563 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 15:42:34,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:42:34,836 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 15:42:34,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:42:35,108 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 15:42:35,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:42:35,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:42:35,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jztv.c.gcp-upstream.internal';"
2026-08-09 15:42:35,893 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 15:42:35,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 15:42:36,152 [I] DB_PATCHES have already been applied
I20260809 15:42:36.158417 14398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBoqIL5/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 15:42:36.158488 14398 mini_ranger.cc:193] Using host: 127.14.15.148
I20260809 15:42:36.162837 14398 mini_ranger.cc:227] Ranger admin URL: http://127.14.15.148:47253
Aug 09, 2026 3:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:42:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:42:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 15:42:37.517272 14398 mini_ranger.cc:160] Time spent starting Ranger: real 8.991s user 0.000s sys 0.012s
Aug 09, 2026 3:43:00 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:43:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 3:43:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:43:00 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:43:01 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 15:43:02.127799 14398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.15.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.15.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangerkms_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.15.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/rangerkms_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.15.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.15.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.15.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/HTTP_127.14.15.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 15:43:02 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290182, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 15:43:02.224365 14398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 15:43:02.237552 14398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 15:43:03.183950 14398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 15:43:03.184028 14398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms
I20260809 15:43:03.184042 14398 mini_ranger_kms.cc:227] Using postgres at 127.14.15.148:51601
2026-08-09 15:43:03,435 [I] DB FLAVOR :POSTGRES
2026-08-09 15:43:03,435 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:43:03,436 [I] Checking connection
2026-08-09 15:43:03,436 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 15:43:03,710 [I] connection success
2026-08-09 15:43:03,710 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 15:43:03,710 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 15:43:03,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 15:43:03,969 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 15:43:03,970 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:43:03,970 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 15:43:03,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.15.148:51601/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 15:43:04,238 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 15:43:04.758893 14398 mini_ranger_kms.cc:310] Created kms service
I20260809 15:43:04.953104 14398 mini_ranger_kms.cc:326] Created kudu user
I20260809 15:43:04.998701 14398 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 15:43:04 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290182, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:05.412123 14398 mini_ranger_kms.cc:384] Added ranger policy
I20260809 15:43:05.412294 14398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBoqIL5/build/debug/bin/postgresql.jar:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBoqIL5/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 15:43:05.412317 14398 mini_ranger_kms.cc:240] Using host: 127.14.15.148
I20260809 15:43:05.417294 14398 mini_ranger_kms.cc:276] Ranger KMS PID: 32339
I20260809 15:43:05.417398 14398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.15.148:33863
Aug 09, 2026 3:43:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:43:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:43:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:43:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:43:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:43:07 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 15:43:08 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786290188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:08.132797 14398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.908s user 0.026s sys 0.211s
I20260809 15:43:08.132952 14398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 15:43:08.133061 14398 mini_ranger_kms.cc:401] 127.14.15.148:33863/kms/v1/keys
Aug 09 15:43:08 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
Aug 09 15:43:08 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.15.148@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
Aug 09 15:43:11 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:43:11.247511 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44961
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:44961
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:11.374868 32409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:11.375201 32409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:11.375293 32409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:11.379418 32409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:11.379518 32409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:11.379557 32409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:11.379595 32409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:11.379634 32409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:11.385977 32409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.15.148:33863/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:44961
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:11.387396 32409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:11.388654 32409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:11.399515 32422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:11.399523 32409 server_base.cc:1034] running on GCE node
W20260809 15:43:11.399782 32416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:11.399549 32419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:11.400731 32409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:11.402019 32409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:11.403251 32409 hybrid_clock.cc:648] HybridClock initialized: now 1786290191403218 us; error 52 us; skew 500 ppm
Aug 09 15:43:11 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290191, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:11.406471 32409 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:11.407531 32409 webserver.cc:460] Webserver started at http://127.14.15.190:38121/ using document root <none> and password file <none>
I20260809 15:43:11.408113 32409 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:11.408171 32409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:11.408403 32409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:43:11 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290191, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:11.464113 32409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "1d0e64e2e96445129123ee51dcf084ca"
format_stamp: "Formatted at 2026-08-09 15:43:11 on dist-test-slave-jztv"
server_key: "6c9b89e60b599b3ea2703ff2bdff673e"
server_key_iv: "fd7540b447ece9d53060940c1ff6b774"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:11.464798 32409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "1d0e64e2e96445129123ee51dcf084ca"
format_stamp: "Formatted at 2026-08-09 15:43:11 on dist-test-slave-jztv"
server_key: "6c9b89e60b599b3ea2703ff2bdff673e"
server_key_iv: "fd7540b447ece9d53060940c1ff6b774"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:11.469053 32409 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:43:11.486745 32432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:11.488363 32409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:43:11.488523 32409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "1d0e64e2e96445129123ee51dcf084ca"
format_stamp: "Formatted at 2026-08-09 15:43:11 on dist-test-slave-jztv"
server_key: "6c9b89e60b599b3ea2703ff2bdff673e"
server_key_iv: "fd7540b447ece9d53060940c1ff6b774"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:11.488672 32409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:11.516752 32409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:11.519704 32409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:11.519910 32409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:11.527794 32409 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:44961
I20260809 15:43:11.527817 32501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:44961 every 8 connection(s)
I20260809 15:43:11.528812 32409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:11.531781 32502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:11.537370 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 32409
I20260809 15:43:11.537509 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:43:11.537817 32502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Bootstrap starting.
I20260809 15:43:11.538116 14398 external_mini_cluster.cc:1428] Setting key 46b1a3cc2173b114885a15d897d54d14
I20260809 15:43:11.540848 32502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:11.541723 32502 log.cc:824] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:11.543859 32502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: No bootstrap required, opened a new log
Aug 09 15:43:11 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:11.548761 32502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:11.549008 32502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:11.549070 32502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0e64e2e96445129123ee51dcf084ca, State: Initialized, Role: FOLLOWER
I20260809 15:43:11.549607 32502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:11.549780 32502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:11.549988 32502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:11.550124 32502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:11.551556 32502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:11.552022 32502 leader_election.cc:302] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d0e64e2e96445129123ee51dcf084ca; no voters:
I20260809 15:43:11.552414 32502 leader_election.cc:288] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:43:11.552541 32511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:11.552814 32511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 LEADER]: Becoming Leader. State: Replica: 1d0e64e2e96445129123ee51dcf084ca, State: Running, Role: LEADER
I20260809 15:43:11.553216 32511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:11.553853 32502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:11.554448 32506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:11.539791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40880 (local address 127.14.15.190:44961)
0809 15:43:11.540219 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:11.540234 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:11.540270 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:43:11.540927 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:11.540953 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:11.541310 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:11.541598 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:11.542624 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:11.543603 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:11.544959 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:11.545415 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:11.545533 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:11.548765 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:11.548770 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:11.548785 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:11.548815 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:11.550956 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:11.551444 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:11.551451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:11.551460 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:11.551614 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:11.551953 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:11.551957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:11.551958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:11.552562 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:11.552790 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:11.553138 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 15:43:11.553428 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":145,"threads_started":1}
I20260809 15:43:11.555132 32513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0e64e2e96445129123ee51dcf084ca. Latest consensus state: current_term: 1 leader_uuid: "1d0e64e2e96445129123ee51dcf084ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } } }
I20260809 15:43:11.555261 32513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:11.555775 32522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:11.556324 32502 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:43:11.556519 32512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d0e64e2e96445129123ee51dcf084ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } } }
I20260809 15:43:11.556730 32512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:11.562510 32522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:11.570679 32522 catalog_manager.cc:1347] Generated new cluster ID: 1e7ffe354aaa4d10bd9d89afbaeb009f
I20260809 15:43:11.570767 32522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:11.596043 32522 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:43:11.597435 32522 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:11.605463 32522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Generated new TSK 0
I20260809 15:43:11.606585 32522 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:43:12.318588 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:12.463968 32567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:12.464380 32567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:12.464454 32567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:12.470753 32567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:12.470841 32567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:12.470932 32567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:12.479034 32567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:12.480629 32567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:12.481694 32567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:12.492095 32577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:12.492038 32576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:12.492225 32579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:12.493260 32567 server_base.cc:1034] running on GCE node
I20260809 15:43:12.493854 32567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:12.494740 32567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:12.495924 32567 hybrid_clock.cc:648] HybridClock initialized: now 1786290192495890 us; error 47 us; skew 500 ppm
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:12.499588 32567 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:12.500700 32567 webserver.cc:460] Webserver started at http://127.14.15.129:40401/ using document root <none> and password file <none>
I20260809 15:43:12.501394 32567 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:12.501480 32567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:12.501718 32567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:12.533471 32567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "07d8c907c8ec469ea2301f492141eb8e"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "a93850c0056539778885bf5b3e3a5b13"
server_key_iv: "a2456aa2260145dd70b048a897afee5a"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.534328 32567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "07d8c907c8ec469ea2301f492141eb8e"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "a93850c0056539778885bf5b3e3a5b13"
server_key_iv: "a2456aa2260145dd70b048a897afee5a"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.547533 32567 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.000s
I20260809 15:43:12.570648 32592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:12.572449 32567 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260809 15:43:12.572690 32567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "07d8c907c8ec469ea2301f492141eb8e"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "a93850c0056539778885bf5b3e3a5b13"
server_key_iv: "a2456aa2260145dd70b048a897afee5a"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.572929 32567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:12.598038 32567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:12.602360 32567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:12.602579 32567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:12.603314 32567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:12.604519 32567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:12.604588 32567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:12.604646 32567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:12.604703 32567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:12.616348 32567 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:35975
I20260809 15:43:12.616420 32760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:35975 every 8 connection(s)
I20260809 15:43:12.617702 32567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:12.620553 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 32567
I20260809 15:43:12.620707 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:43:12.621035 14398 external_mini_cluster.cc:1428] Setting key 83127aea2f4f135da2af957114107139
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:12.648294 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:12.630658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:46571 (local address 127.14.15.190:44961)
0809 15:43:12.634508 (+ 3850us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:12.634513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:12.634529 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:43:12.634578 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:12.634581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:12.634650 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:12.634751 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:12.636391 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:12.637277 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:12.639183 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:12.639551 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:12.639677 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:12.642883 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:12.642887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:12.642890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:12.642922 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:12.644899 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:12.645590 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:12.645594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:12.645596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:12.645706 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:12.646135 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:12.646140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:12.646142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:12.646412 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:12.646511 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:12.647947 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0809 15:43:12.648088 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3758,"thread_start_us":87,"threads_started":1}
I20260809 15:43:12.649391 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:12.629381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.129:46571)
0809 15:43:12.631116 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:12.631184 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:12.632292 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:12.635092 (+ 2800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:12.635102 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:12.635490 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:12.636196 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:12.636220 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:12.637443 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:12.637446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:12.639032 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:12.639044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:12.639875 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:12.639880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:12.640088 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:12.640865 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:12.640888 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:12.642666 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:12.645051 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:12.645058 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:12.645078 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:12.645458 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:12.645818 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:12.645821 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:12.645823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:12.646020 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:12.646572 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:12.646579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:12.646945 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 15:43:12.647170 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 15:43:12.647550 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1489,"thread_start_us":183,"threads_started":1}
I20260809 15:43:12.650928 32762 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:43:12.651233 32762 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:12.651772 32762 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:12.653757 32456 ts_manager.cc:194] Registered new tserver with Master: 07d8c907c8ec469ea2301f492141eb8e (127.14.15.129:35975)
I20260809 15:43:12.655496 32456 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:46571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:43:12.678493 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:12.854481 302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:12.854961 302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:12.855082 302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:12.859990 302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:12.860177 302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:12.860344 302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:12.867434 302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:12.868844 302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:12.870158 302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:12.883510 312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:12.883466 311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:12.883503 314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:12.884361 302 server_base.cc:1034] running on GCE node
I20260809 15:43:12.884812 302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:12.885489 302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:12.886683 302 hybrid_clock.cc:648] HybridClock initialized: now 1786290192886647 us; error 56 us; skew 500 ppm
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:12.890446 302 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:12.892058 302 webserver.cc:460] Webserver started at http://127.14.15.130:35485/ using document root <none> and password file <none>
I20260809 15:43:12.892908 302 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:12.893005 302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:12.893409 302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:43:12 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:12.914746 302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "ba8681c8bc0a49959947ff84ecf3cddd"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "3fac6ba7ae5558a36265c35b99e84e11"
server_key_iv: "4e6c2d47ec8cfa62aed33c35720aeef4"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.915835 302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "ba8681c8bc0a49959947ff84ecf3cddd"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "3fac6ba7ae5558a36265c35b99e84e11"
server_key_iv: "4e6c2d47ec8cfa62aed33c35720aeef4"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.923887 302 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260809 15:43:12.942315 323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:12.944124 302 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260809 15:43:12.944355 302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "ba8681c8bc0a49959947ff84ecf3cddd"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "3fac6ba7ae5558a36265c35b99e84e11"
server_key_iv: "4e6c2d47ec8cfa62aed33c35720aeef4"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:12.944594 302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:12.972843 302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:12.976598 302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:12.976889 302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:12.977944 302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:12.979517 302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:12.979629 302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:12.979736 302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:12.979805 302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.002461 302 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44101
I20260809 15:43:13.003737 302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:13.011606 499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44101 every 8 connection(s)
I20260809 15:43:13.012292 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 302
I20260809 15:43:13.012428 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:43:13.012785 14398 external_mini_cluster.cc:1428] Setting key 1586418d847f7289484fe971b3c2643b
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:13.027848 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:13.006312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:32831 (local address 127.14.15.190:44961)
0809 15:43:13.006459 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:13.006464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:13.007699 (+ 1235us) server_negotiation.cc:407] Connection header received
0809 15:43:13.009000 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:13.009005 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:13.009067 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:13.009126 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:13.011060 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.011914 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.018340 (+ 6426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.018702 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.018796 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:13.022652 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:13.022657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:13.022660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:13.022691 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:13.024544 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:13.025267 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:13.025271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:13.025272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:13.025369 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:13.025831 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:13.025835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:13.025837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:13.026458 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:13.026561 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:13.027372 (+ 811us) server_negotiation.cc:299] Negotiation successful
0809 15:43:13.027662 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:43:13.029933 502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:13.006831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.130:32831)
0809 15:43:13.007517 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:13.007579 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:13.008717 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:13.009567 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:13.009577 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:13.009960 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:13.010846 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:13.010871 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.013387 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.013391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:13.018122 (+ 4731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:13.018138 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.019046 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.019051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:13.019269 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:13.020530 (+ 1261us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:13.020554 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:13.022415 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:13.024711 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:13.024717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:13.024738 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:13.025134 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:13.025494 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:13.025497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:13.025499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:13.025710 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:13.026639 (+ 929us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:13.026646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:13.027029 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 15:43:13.028190 (+ 1161us) client_negotiation.cc:240] Negotiation successful
0809 15:43:13.028608 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":222,"threads_started":1}
I20260809 15:43:13.031534 500 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
I20260809 15:43:13.031797 500 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:43:13.032430 500 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:13.033617 32456 ts_manager.cc:194] Registered new tserver with Master: ba8681c8bc0a49959947ff84ecf3cddd (127.14.15.130:44101)
I20260809 15:43:13.034420 32456 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:32831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:43:13.053274 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
W20260809 15:43:13.232671 510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:13.232977 510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:13.233024 510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:13.237354 510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:13.237433 510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:13.237540 510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:13.243384 510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:13.244644 510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:13.245752 510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:13.258128 525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.258335 510 server_base.cc:1034] running on GCE node
W20260809 15:43:13.258158 522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:13.258188 521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.259543 510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:13.260557 510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:13.261749 510 hybrid_clock.cc:648] HybridClock initialized: now 1786290193261724 us; error 42 us; skew 500 ppm
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:13.265501 510 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:13.266772 510 webserver.cc:460] Webserver started at http://127.14.15.131:37717/ using document root <none> and password file <none>
I20260809 15:43:13.267545 510 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:13.267637 510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:13.267957 510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:13.285531 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e"
format_stamp: "Formatted at 2026-08-09 15:43:13 on dist-test-slave-jztv"
server_key: "f6bc3ea239aaa208e1a498a3bf5b5730"
server_key_iv: "ec9e55bfcd7b9ca5405f52467a0645ab"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:13.286733 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e"
format_stamp: "Formatted at 2026-08-09 15:43:13 on dist-test-slave-jztv"
server_key: "f6bc3ea239aaa208e1a498a3bf5b5730"
server_key_iv: "ec9e55bfcd7b9ca5405f52467a0645ab"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:13.299618 510 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.004s sys 0.000s
I20260809 15:43:13.318434 535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.320228 510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:13.320446 510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e"
format_stamp: "Formatted at 2026-08-09 15:43:13 on dist-test-slave-jztv"
server_key: "f6bc3ea239aaa208e1a498a3bf5b5730"
server_key_iv: "ec9e55bfcd7b9ca5405f52467a0645ab"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:13.320662 510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:13.352210 510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:13.356405 510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:13.356683 510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:13.357453 510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:13.358743 510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:13.358819 510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.358875 510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:13.358913 510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.372334 510 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45315
I20260809 15:43:13.372524 698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45315 every 8 connection(s)
I20260809 15:43:13.373535 510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:13.378163 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 510
I20260809 15:43:13.378324 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:43:13.378677 14398 external_mini_cluster.cc:1428] Setting key dc96148813808822cb8eb28995717d1a
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:13.390987 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:13.375730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:39609 (local address 127.14.15.190:44961)
0809 15:43:13.375865 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:13.375870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:13.376954 (+ 1084us) server_negotiation.cc:407] Connection header received
0809 15:43:13.378200 (+ 1246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:13.378204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:13.378289 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:13.378343 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:13.379952 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.380776 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.382472 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.382815 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.382951 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:13.386029 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:13.386034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:13.386037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:13.386073 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:13.387969 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:13.388730 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:13.388735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:13.388737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:13.388837 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:13.389315 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:13.389318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:13.389320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:13.389600 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:13.389684 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:13.390637 (+ 953us) server_negotiation.cc:299] Negotiation successful
0809 15:43:13.390791 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:43:13.393767 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:13.376223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.131:39609)
0809 15:43:13.376791 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:13.376847 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:13.377938 (+ 1091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:13.378754 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:13.378762 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:13.379121 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:13.379783 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:13.379800 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.380940 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.380943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:13.382335 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:13.382347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:13.383001 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:13.383005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:13.383203 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:13.383919 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:13.383941 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:13.385784 (+ 1843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:13.388141 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:13.388149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:13.388172 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:13.388587 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:13.388979 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:13.388983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:13.388985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:13.389196 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:13.389778 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:13.389785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:13.390306 (+ 521us) client_negotiation.cc:769] Sending connection context
0809 15:43:13.392202 (+ 1896us) client_negotiation.cc:240] Negotiation successful
0809 15:43:13.392667 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":150,"threads_started":1}
I20260809 15:43:13.395367 699 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
I20260809 15:43:13.395658 699 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:13.396292 699 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:13.399206 32456 ts_manager.cc:194] Registered new tserver with Master: 6f1a85d2c15a46d9bef5b0836d0b6d2e (127.14.15.131:45315)
I20260809 15:43:13.399961 32456 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:39609
I20260809 15:43:13.405104 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:43:13.406927 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 32567
I20260809 15:43:13.430012 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 302
I20260809 15:43:13.446784 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 510
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290192, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:13.461493 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 32409
I20260809 15:43:13.479223 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44961
--webserver_interface=127.14.15.190
--webserver_port=38121
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:44961
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:13.599313 706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:13.599663 706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:13.599704 706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:13.604169 706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:13.604269 706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:13.604298 706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:13.604319 706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:13.604336 706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:13.610560 706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:44961
--ranger_config_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:44961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=38121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:13.611800 706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:13.612910 706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:13.622187 714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.622334 706 server_base.cc:1034] running on GCE node
W20260809 15:43:13.622184 716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:13.622189 713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.623234 706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:13.624433 706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:13.625598 706 hybrid_clock.cc:648] HybridClock initialized: now 1786290193625567 us; error 45 us; skew 500 ppm
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:13.628463 706 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:13.629459 706 webserver.cc:460] Webserver started at http://127.14.15.190:38121/ using document root <none> and password file <none>
I20260809 15:43:13.630039 706 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:13.630137 706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:13.676038 706 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:43:13.678951 725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.680634 706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:43:13.680781 706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "1d0e64e2e96445129123ee51dcf084ca"
format_stamp: "Formatted at 2026-08-09 15:43:11 on dist-test-slave-jztv"
server_key: "6c9b89e60b599b3ea2703ff2bdff673e"
server_key_iv: "fd7540b447ece9d53060940c1ff6b774"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:13.681529 706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:13.699777 706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:13.704130 706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:13.704368 706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:13.713644 706 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:44961
I20260809 15:43:13.713657 807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:44961 every 8 connection(s)
I20260809 15:43:13.715139 706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:13.718138 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 706
I20260809 15:43:13.718725 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:35975
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:44961
--webserver_port=40401
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:13.719987 808 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:43:13.721707 808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Bootstrap starting.
I20260809 15:43:13.739164 808 log.cc:824] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:13.746582 808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:43:13.747037 808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Bootstrap complete.
I20260809 15:43:13.751487 808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:13.751957 808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0e64e2e96445129123ee51dcf084ca, State: Initialized, Role: FOLLOWER
I20260809 15:43:13.752665 808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:13.752821 808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:13.752910 808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:13.753031 808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:43:13.755164 808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:13.755534 808 leader_election.cc:302] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d0e64e2e96445129123ee51dcf084ca; no voters:
I20260809 15:43:13.755914 808 leader_election.cc:288] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:43:13.756213 812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:43:13.756480 812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [term 2 LEADER]: Becoming Leader. State: Replica: 1d0e64e2e96445129123ee51dcf084ca, State: Running, Role: LEADER
I20260809 15:43:13.756852 812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } }
I20260809 15:43:13.757263 808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:13.757961 812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1d0e64e2e96445129123ee51dcf084ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } } }
I20260809 15:43:13.758174 812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:13.758577 812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0e64e2e96445129123ee51dcf084ca. Latest consensus state: current_term: 2 leader_uuid: "1d0e64e2e96445129123ee51dcf084ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0e64e2e96445129123ee51dcf084ca" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 44961 } } }
I20260809 15:43:13.758721 812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:13.759747 808 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:43:13.760960 824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:13.767390 824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:13.768182 824 catalog_manager.cc:1259] Loaded cluster ID: 1e7ffe354aaa4d10bd9d89afbaeb009f
I20260809 15:43:13.768311 824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:13.771114 824 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:13.771906 824 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Loaded TSK: 0
I20260809 15:43:13.773294 824 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:43:13.896927 810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:13.897456 810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:13.897585 810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:13.903949 810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:13.904179 810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:13.904376 810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:13.912523 810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:35975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=40401
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:13.914131 810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:13.915642 810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:13.929747 856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:13.930167 857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.931285 810 server_base.cc:1034] running on GCE node
W20260809 15:43:13.931643 859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:13.932206 810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:13.933046 810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:13.934270 810 hybrid_clock.cc:648] HybridClock initialized: now 1786290193934234 us; error 48 us; skew 500 ppm
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:13.940853 810 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:13.942292 810 webserver.cc:460] Webserver started at http://127.14.15.129:40401/ using document root <none> and password file <none>
I20260809 15:43:13.943158 810 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:13.943339 810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:43:13 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:13.976014 810 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.003s sys 0.000s
I20260809 15:43:13.979064 874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:13.980858 810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:13.981035 810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "07d8c907c8ec469ea2301f492141eb8e"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "a93850c0056539778885bf5b3e3a5b13"
server_key_iv: "a2456aa2260145dd70b048a897afee5a"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:13.981812 810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:14.021426 810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:14.025413 810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:14.025635 810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:14.026499 810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:14.027669 810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:14.027734 810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.027794 810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:14.027822 810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.039232 810 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:35975
I20260809 15:43:14.040702 810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:14.043057 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 810
I20260809 15:43:14.043581 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:44101
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:44961
--webserver_port=35485
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:14.051937 1043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:35975 every 8 connection(s)
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290193, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:14.080957 1050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.054592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:49413 (local address 127.14.15.190:44961)
0809 15:43:14.062569 (+ 7977us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:14.062597 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:14.062659 (+ 62us) server_negotiation.cc:407] Connection header received
0809 15:43:14.063031 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:14.063051 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:14.063553 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:14.064000 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:14.065635 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.067341 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.069156 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.069899 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.070093 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.073711 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:14.073719 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:14.073741 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:14.073781 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:14.077320 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.077981 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.077988 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.077994 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.078139 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.078563 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.078568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.078570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.078974 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:14.079136 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:14.079724 (+ 588us) server_negotiation.cc:299] Negotiation successful
0809 15:43:14.079975 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7739,"thread_start_us":124,"threads_started":1}
I20260809 15:43:14.080973 1048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.052963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.129:49413)
0809 15:43:14.053626 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:14.053688 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:14.054871 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:14.064180 (+ 9309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:14.064192 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:14.064615 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:14.065352 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.065377 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.067586 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.067590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.068974 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.068988 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.070372 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.070376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.070571 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.071346 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:14.071370 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:14.073403 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:14.077498 (+ 4095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.077510 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.077523 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.077828 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.078309 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.078311 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.078312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.078457 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.079116 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:14.079123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:14.079389 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 15:43:14.079604 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 15:43:14.079975 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":169,"threads_started":1}
I20260809 15:43:14.088483 1044 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
I20260809 15:43:14.088799 1044 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.089495 1044 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.092125 1044 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:44961 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 15:43:14.092279 1044 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.092512 1044 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:14.093528 1044 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.093743 1044 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.094652 1044 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:43:14.213973 1047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:14.214720 1047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:14.214802 1047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:14.220600 1047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:14.220697 1047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:14.220795 1047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:14.228891 1047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:44101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=35485
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:14.230437 1047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:14.231863 1047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:14.245144 1058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:14.245364 1056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:14.245929 1047 server_base.cc:1034] running on GCE node
W20260809 15:43:14.245981 1060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:14.246605 1047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:14.247414 1047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:14.248617 1047 hybrid_clock.cc:648] HybridClock initialized: now 1786290194248550 us; error 81 us; skew 500 ppm
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:14.252166 1047 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:14.253298 1047 webserver.cc:460] Webserver started at http://127.14.15.130:35485/ using document root <none> and password file <none>
I20260809 15:43:14.253997 1047 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:14.254112 1047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:14.273972 1047 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:43:14.276971 1070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.278492 1047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:14.278604 1047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "ba8681c8bc0a49959947ff84ecf3cddd"
format_stamp: "Formatted at 2026-08-09 15:43:12 on dist-test-slave-jztv"
server_key: "3fac6ba7ae5558a36265c35b99e84e11"
server_key_iv: "4e6c2d47ec8cfa62aed33c35720aeef4"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:14.279510 1047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:14.309119 1047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:14.312889 1047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:14.313138 1047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:14.313901 1047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:14.315102 1047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:14.315186 1047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.315259 1047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:14.315292 1047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.327301 1047 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44101
I20260809 15:43:14.327844 1233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44101 every 8 connection(s)
I20260809 15:43:14.328727 1047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:14.337641 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1047
I20260809 15:43:14.338186 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.15.148:33863/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:45315
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:44961
--webserver_port=37717
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:14.347245 1050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.331335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:38675 (local address 127.14.15.190:44961)
0809 15:43:14.331488 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:14.331492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:14.332559 (+ 1067us) server_negotiation.cc:407] Connection header received
0809 15:43:14.333536 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:14.333540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:14.333613 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:14.333701 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:14.334902 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.335451 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.336818 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.337184 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.337270 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.340330 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:14.340334 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:14.340337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:14.340369 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:14.342293 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.345151 (+ 2858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.345155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.345157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.345264 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.345749 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.345753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.345755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.346025 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:14.346108 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:14.346898 (+ 790us) server_negotiation.cc:299] Negotiation successful
0809 15:43:14.347068 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:43:14.348951 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.331831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.130:38675)
0809 15:43:14.332381 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:14.332424 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:14.333304 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:14.333902 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:14.333909 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:14.334205 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:14.334739 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.334753 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.335596 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.335606 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.336660 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.336672 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.337501 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.337505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.337710 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.338464 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:14.338489 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:14.340094 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:14.344603 (+ 4509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.344611 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.344632 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.345010 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.345398 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.345402 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.345403 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.345617 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.346201 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:14.346237 (+ 36us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:14.346591 (+ 354us) client_negotiation.cc:769] Sending connection context
0809 15:43:14.347441 (+ 850us) client_negotiation.cc:240] Negotiation successful
0809 15:43:14.347821 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":155,"threads_started":1}
I20260809 15:43:14.350324 1234 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
I20260809 15:43:14.350600 1234 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.351243 1234 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.353106 1234 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:44961 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 15:43:14.353236 1234 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.353410 1234 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:14.354346 1234 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.354521 1234 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.355464 1234 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:43:14.491921 1238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:14.492214 1238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:14.492259 1238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:14.497459 1238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:14.497530 1238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:14.497619 1238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:14.503767 1238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.15.148:33863/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:45315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=37717
--tserver_master_addrs=127.14.15.190:44961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:14.504973 1238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:14.506071 1238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:14.517999 1248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:14.518181 1252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:14.518323 1249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:14.519304 1238 server_base.cc:1034] running on GCE node
I20260809 15:43:14.519793 1238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:14.520555 1238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:14.521765 1238 hybrid_clock.cc:648] HybridClock initialized: now 1786290194521730 us; error 49 us; skew 500 ppm
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:14.524793 1238 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:14.525853 1238 webserver.cc:460] Webserver started at http://127.14.15.131:37717/ using document root <none> and password file <none>
I20260809 15:43:14.526515 1238 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:14.526628 1238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:14.548270 1238 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:43:14.551987 1261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.553738 1238 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:43:14.553889 1238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e"
format_stamp: "Formatted at 2026-08-09 15:43:13 on dist-test-slave-jztv"
server_key: "f6bc3ea239aaa208e1a498a3bf5b5730"
server_key_iv: "ec9e55bfcd7b9ca5405f52467a0645ab"
server_key_version: "kuduclusterkey@0"
I20260809 15:43:14.554695 1238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:14.576152 1238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:14.579924 1238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:14.580140 1238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:14.580917 1238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:14.582017 1238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:14.582087 1238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.582150 1238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:14.582187 1238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:14.594101 1238 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45315
I20260809 15:43:14.594297 1416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45315 every 8 connection(s)
I20260809 15:43:14.595533 1238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:14.599213 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1238
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:14.613580 1422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.600386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40888 (local address 127.14.15.190:44961)
0809 15:43:14.601076 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:14.601081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:14.601095 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:43:14.601141 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:14.601145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:14.601192 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:14.601281 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:14.602469 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.603309 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.604629 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.605004 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.605121 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.608943 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:14.608947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:14.608950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:14.608985 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:14.610936 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.611515 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.611522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.611523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.611627 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.611961 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.611966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.611967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.612221 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:14.612424 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:14.613252 (+ 828us) server_negotiation.cc:299] Negotiation successful
0809 15:43:14.613381 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"spinlock_wait_cycles":2432,"thread_start_us":112,"threads_started":1}
I20260809 15:43:14.614090 1050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.598993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:35361 (local address 127.14.15.190:44961)
0809 15:43:14.599171 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:14.599177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:14.600298 (+ 1121us) server_negotiation.cc:407] Connection header received
0809 15:43:14.601736 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:14.601742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:14.601801 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:14.601856 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:14.603609 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.604418 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.606190 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.606560 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.606640 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.609831 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:14.609836 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:14.609839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:14.609898 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:14.611571 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.612238 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.612244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.612249 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.612327 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:14.612764 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:14.612768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:14.612769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:14.612997 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:14.613076 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:14.613820 (+ 744us) server_negotiation.cc:299] Negotiation successful
0809 15:43:14.613942 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64,"spinlock_wait_cycles":5376}
I20260809 15:43:14.616061 1420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:14.599495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:44961 (local address 127.14.15.131:35361)
0809 15:43:14.600115 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:14.600188 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:14.601464 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:14.602385 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:14.602399 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:14.602780 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:14.603423 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.603448 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.604595 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.604601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.606033 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:14.606046 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:14.606862 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:14.606868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:14.607083 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:14.607685 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:14.607708 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:14.609620 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:14.611706 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.611714 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.611733 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.612124 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.612442 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:14.612446 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:14.612449 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:14.612645 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:14.613167 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:14.613175 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:14.613515 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 15:43:14.614309 (+ 794us) client_negotiation.cc:240] Negotiation successful
0809 15:43:14.614694 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":150,"threads_started":1}
I20260809 15:43:14.617161 1418 heartbeater.cc:347] Connected to a master server at 127.14.15.190:44961
I20260809 15:43:14.617408 1418 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.617940 1418 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.619659 1418 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:44961 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 15:43:14.619808 1418 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.620023 1418 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:14.621325 1418 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:14.621533 1418 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
W20260809 15:43:14.622481 1418 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 15:43:14 dist-test-slave-jztv krb5kdc[31773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:15.094898 1044 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:15.095219 1044 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:15.096501 757 ts_manager.cc:194] Registered new tserver with Master: 07d8c907c8ec469ea2301f492141eb8e (127.14.15.129:35975)
I20260809 15:43:15.098356 757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:49413
I20260809 15:43:15.355718 1234 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:15.356066 1234 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:15.356979 757 ts_manager.cc:194] Registered new tserver with Master: ba8681c8bc0a49959947ff84ecf3cddd (127.14.15.130:44101)
I20260809 15:43:15.357759 757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:38675
Aug 09 15:43:15 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
I20260809 15:43:15.622718 1418 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:15.623054 1418 heartbeater.cc:511] Master 127.14.15.190:44961 requested a full tablet report, sending...
I20260809 15:43:15.623860 755 ts_manager.cc:194] Registered new tserver with Master: 6f1a85d2c15a46d9bef5b0836d0b6d2e (127.14.15.131:45315)
I20260809 15:43:15.624677 755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:35361
I20260809 15:43:15.635742 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:43:15.649647 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.639003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53296 (local address 127.14.15.190:44961)
0809 15:43:15.639695 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.639700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.639718 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:43:15.639765 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.639771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.639822 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.640794 (+ 972us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:15.640900 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.641650 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.642595 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.642947 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.645157 (+ 2210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.645291 (+ 134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:15.645294 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:15.645297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:15.645315 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:15.647335 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:15.647902 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:15.647905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:15.647907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:15.648003 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:15.648347 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:15.648350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:15.648352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:15.648579 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:15.649323 (+ 744us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.649393 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.649499 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":93,"threads_started":1}
I20260809 15:43:15.655057 755 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
Aug 09 15:43:15 dist-test-slave-jztv krb5kdc[31773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290194, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for HTTP/127.14.15.148@KRBTEST.COM
W20260809 15:43:15.659740 755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:43:15.688100 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.674773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:44101 (local address 127.0.0.1:49976)
0809 15:43:15.678258 (+ 3485us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:15.678317 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:15.678455 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:15.683218 (+ 4763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:15.683236 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:15.683260 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:15.683411 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.683418 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.684883 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.684887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.686294 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.686303 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.687552 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.687559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.687668 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.687711 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 15:43:15.687817 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 15:43:15.687941 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3256,"thread_start_us":117,"threads_started":1}
I20260809 15:43:15.690055 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.677211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:35975 (local address 127.0.0.1:54450)
0809 15:43:15.678367 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:15.678384 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:15.678499 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:15.683781 (+ 5282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:15.683784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:15.683802 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:15.684069 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.684075 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.686272 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.686276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.687509 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.687522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.689693 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.689697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.689786 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.689811 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:43:15.689854 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 15:43:15.689927 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1075,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260809 15:43:15.690750 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.677435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.14.15.129:35975)
0809 15:43:15.683149 (+ 5714us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.683157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.683179 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:43:15.683276 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.683281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.683473 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.683621 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:15.684182 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.686108 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.687659 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.689566 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.690336 (+ 770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.690478 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.690530 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.690616 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5601,"thread_start_us":132,"threads_started":1}
I20260809 15:43:15.690786 1468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.677802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45315 (local address 127.0.0.1:36588)
0809 15:43:15.682767 (+ 4965us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:15.682781 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:15.682884 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:15.683769 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:15.683772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:15.683794 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:15.683943 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.683950 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.687593 (+ 3643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.687597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.688740 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.688752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.690397 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.690402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.690495 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.690522 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:43:15.690576 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 15:43:15.690642 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4903,"mutex_wait_us":23,"thread_start_us":109,"threads_started":1}
I20260809 15:43:15.691749 1471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.678201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36588 (local address 127.14.15.131:45315)
0809 15:43:15.682626 (+ 4425us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.682632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.682906 (+ 274us) server_negotiation.cc:407] Connection header received
0809 15:43:15.683027 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.683035 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.683435 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.684125 (+ 690us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:15.684303 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.687449 (+ 3146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.689191 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.690022 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.691311 (+ 1289us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.691467 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.691520 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.691609 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4242,"thread_start_us":82,"threads_started":1}
I20260809 15:43:15.693843 935 tablet_service.cc:1467] Processing CreateTablet for tablet db14ce05798c4310b709c34bbf478c37 (DEFAULT_TABLE table=test-table [id=cbed4b94b8954dd4ad296b8764589575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:15.694461 1321 tablet_service.cc:1467] Processing CreateTablet for tablet db14ce05798c4310b709c34bbf478c37 (DEFAULT_TABLE table=test-table [id=cbed4b94b8954dd4ad296b8764589575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:15.695060 935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db14ce05798c4310b709c34bbf478c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:15.695415 1321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db14ce05798c4310b709c34bbf478c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:15.706748 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.675914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49976 (local address 127.14.15.130:44101)
0809 15:43:15.682462 (+ 6548us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.682471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.682498 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:43:15.682585 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.682591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.682852 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.683020 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:15.683558 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.684744 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.686430 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.687227 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.687329 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.687491 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.706414 (+ 18923us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.706564 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6412,"thread_start_us":116,"threads_started":1}
I20260809 15:43:15.709769 1136 tablet_service.cc:1467] Processing CreateTablet for tablet db14ce05798c4310b709c34bbf478c37 (DEFAULT_TABLE table=test-table [id=cbed4b94b8954dd4ad296b8764589575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:15.711118 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db14ce05798c4310b709c34bbf478c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:15.723616 1473 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Bootstrap starting.
I20260809 15:43:15.726450 1473 tablet_bootstrap.cc:654] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:15.726632 1475 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Bootstrap starting.
I20260809 15:43:15.727573 1473 log.cc:824] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:15.728452 1472 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Bootstrap starting.
I20260809 15:43:15.728907 1475 tablet_bootstrap.cc:654] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:15.729740 1475 log.cc:824] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:15.730782 1472 tablet_bootstrap.cc:654] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:15.731630 1472 log.cc:824] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:15.734361 1472 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: No bootstrap required, opened a new log
I20260809 15:43:15.734596 1472 ts_tablet_manager.cc:1397] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.002s
I20260809 15:43:15.734383 1473 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: No bootstrap required, opened a new log
I20260809 15:43:15.735785 1473 ts_tablet_manager.cc:1397] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260809 15:43:15.739945 1473 raft_consensus.cc:348] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.740365 1473 raft_consensus.cc:374] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:15.740522 1473 raft_consensus.cc:729] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d8c907c8ec469ea2301f492141eb8e, State: Initialized, Role: FOLLOWER
I20260809 15:43:15.740742 1472 raft_consensus.cc:348] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.741212 1473 consensus_queue.cc:260] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.741005 1472 raft_consensus.cc:374] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:15.741874 1472 raft_consensus.cc:729] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1a85d2c15a46d9bef5b0836d0b6d2e, State: Initialized, Role: FOLLOWER
I20260809 15:43:15.742508 1472 consensus_queue.cc:260] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.742611 1473 ts_tablet_manager.cc:1428] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260809 15:43:15.743073 1044 heartbeater.cc:503] Master 127.14.15.190:44961 was elected leader, sending a full tablet report...
I20260809 15:43:15.743552 1472 ts_tablet_manager.cc:1428] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260809 15:43:15.743906 1418 heartbeater.cc:503] Master 127.14.15.190:44961 was elected leader, sending a full tablet report...
I20260809 15:43:15.747984 1475 tablet_bootstrap.cc:492] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: No bootstrap required, opened a new log
I20260809 15:43:15.748202 1475 ts_tablet_manager.cc:1397] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260809 15:43:15.753932 1475 raft_consensus.cc:348] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.754251 1475 raft_consensus.cc:374] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:15.754315 1475 raft_consensus.cc:729] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8681c8bc0a49959947ff84ecf3cddd, State: Initialized, Role: FOLLOWER
I20260809 15:43:15.754819 1475 consensus_queue.cc:260] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.755569 1234 heartbeater.cc:503] Master 127.14.15.190:44961 was elected leader, sending a full tablet report...
I20260809 15:43:15.757074 1475 ts_tablet_manager.cc:1428] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
W20260809 15:43:15.793491 1045 tablet.cc:2369] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:43:15.831200 1235 tablet.cc:2369] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:43:15.849432 1419 tablet.cc:2369] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:15.880923 1483 raft_consensus.cc:482] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:43:15.881197 1483 raft_consensus.cc:504] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.882761 1483 leader_election.cc:288] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d8c907c8ec469ea2301f492141eb8e (127.14.15.129:35975), 6f1a85d2c15a46d9bef5b0836d0b6d2e (127.14.15.131:45315)
I20260809 15:43:15.898581 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.884175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:40281 (local address 127.14.15.129:35975)
0809 15:43:15.884338 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.884343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.887652 (+ 3309us) server_negotiation.cc:407] Connection header received
0809 15:43:15.888061 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.888065 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.888125 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.888190 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:15.889661 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.890564 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.895481 (+ 4917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.896072 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.896171 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.896227 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.898310 (+ 2083us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.898413 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:43:15.899151 1488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.883194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:35975 (local address 127.14.15.130:40281)
0809 15:43:15.887540 (+ 4346us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:15.887557 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:15.887749 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:15.888357 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:15.888360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:15.889070 (+ 710us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:15.889236 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.889245 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.890716 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.890719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.892098 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.892110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.896325 (+ 4215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.896328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.896431 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.896455 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:43:15.898887 (+ 2432us) client_negotiation.cc:240] Negotiation successful
0809 15:43:15.898978 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4248,"thread_start_us":144,"threads_started":1}
I20260809 15:43:15.899858 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.883683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45315 (local address 127.14.15.130:48495)
0809 15:43:15.889403 (+ 5720us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:15.889417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:15.889530 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:15.892231 (+ 2701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:15.892234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:15.892256 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:15.892369 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.892375 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.894051 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.894055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.895302 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:15.895314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.898019 (+ 2705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.898023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:15.898127 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.898154 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:43:15.899646 (+ 1492us) client_negotiation.cc:240] Negotiation successful
0809 15:43:15.899723 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5314,"thread_start_us":100,"threads_started":1}
I20260809 15:43:15.899899 1471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.884340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:48495 (local address 127.14.15.131:45315)
0809 15:43:15.884460 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.884465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.889494 (+ 5029us) server_negotiation.cc:407] Connection header received
0809 15:43:15.889624 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.889630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.889685 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.889756 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:15.892488 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.893228 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.895429 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.896044 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.896171 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.896227 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.899687 (+ 3460us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.899780 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:43:15.900000 951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db14ce05798c4310b709c34bbf478c37" candidate_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d8c907c8ec469ea2301f492141eb8e" is_pre_election: true
I20260809 15:43:15.900399 951 raft_consensus.cc:2454] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba8681c8bc0a49959947ff84ecf3cddd in term 0.
I20260809 15:43:15.900494 1358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db14ce05798c4310b709c34bbf478c37" candidate_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" is_pre_election: true
I20260809 15:43:15.900796 1358 raft_consensus.cc:2454] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba8681c8bc0a49959947ff84ecf3cddd in term 0.
I20260809 15:43:15.901010 1073 leader_election.cc:302] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d8c907c8ec469ea2301f492141eb8e, ba8681c8bc0a49959947ff84ecf3cddd; no voters:
I20260809 15:43:15.901572 1483 raft_consensus.cc:2781] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:43:15.901679 1483 raft_consensus.cc:482] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:43:15.901728 1483 raft_consensus.cc:3037] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:15.903172 1483 raft_consensus.cc:504] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.903575 1483 leader_election.cc:288] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [CANDIDATE]: Term 1 election: Requested vote from peers 07d8c907c8ec469ea2301f492141eb8e (127.14.15.129:35975), 6f1a85d2c15a46d9bef5b0836d0b6d2e (127.14.15.131:45315)
I20260809 15:43:15.904011 1358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db14ce05798c4310b709c34bbf478c37" candidate_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e"
I20260809 15:43:15.904143 1358 raft_consensus.cc:3037] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:15.905489 1358 raft_consensus.cc:2454] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba8681c8bc0a49959947ff84ecf3cddd in term 1.
I20260809 15:43:15.905854 1071 leader_election.cc:302] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f1a85d2c15a46d9bef5b0836d0b6d2e, ba8681c8bc0a49959947ff84ecf3cddd; no voters:
I20260809 15:43:15.906386 951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db14ce05798c4310b709c34bbf478c37" candidate_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d8c907c8ec469ea2301f492141eb8e"
I20260809 15:43:15.906540 951 raft_consensus.cc:3037] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:15.907871 951 raft_consensus.cc:2454] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba8681c8bc0a49959947ff84ecf3cddd in term 1.
I20260809 15:43:15.908325 1483 raft_consensus.cc:2781] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:15.908604 1483 raft_consensus.cc:686] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 1 LEADER]: Becoming Leader. State: Replica: ba8681c8bc0a49959947ff84ecf3cddd, State: Running, Role: LEADER
I20260809 15:43:15.909003 1483 consensus_queue.cc:237] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } }
I20260809 15:43:15.912864 755 catalog_manager.cc:5495] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd reported cstate change: term changed from 0 to 1, leader changed from <none> to ba8681c8bc0a49959947ff84ecf3cddd (127.14.15.130). New cstate: current_term: 1 leader_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8681c8bc0a49959947ff84ecf3cddd" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 } health_report { overall_health: UNKNOWN } } }
I20260809 15:43:15.932711 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:15.927781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.14.15.130:44101)
0809 15:43:15.927908 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:15.927913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:15.927927 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:43:15.928004 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:15.928007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:15.928069 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:15.928166 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:43:15.928546 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.929329 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.930618 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:15.930950 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:15.931040 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:15.931438 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:43:15.931987 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:43:15.932099 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:15.932478 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 15:43:15.932547 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:43:15.939921 951 raft_consensus.cc:1261] T db14ce05798c4310b709c34bbf478c37 P 07d8c907c8ec469ea2301f492141eb8e [term 1 FOLLOWER]: Refusing update from remote peer ba8681c8bc0a49959947ff84ecf3cddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:15.939926 1358 raft_consensus.cc:1261] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 1 FOLLOWER]: Refusing update from remote peer ba8681c8bc0a49959947ff84ecf3cddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:15.940796 1489 consensus_queue.cc:1035] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f1a85d2c15a46d9bef5b0836d0b6d2e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:15.941282 1483 consensus_queue.cc:1035] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d8c907c8ec469ea2301f492141eb8e" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:15.954519 1494 mvcc.cc:205] Tried to move back new op lower bound from 7316644642561617920 to 7316644642446753792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644642561617920 or (T in {7316644642561617920})}]
I20260809 15:43:15.956879 1496 mvcc.cc:205] Tried to move back new op lower bound from 7316644642561617920 to 7316644642446753792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644642561617920}]
I20260809 15:43:15.960202 757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:15.960394 757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:15.963738 1497 mvcc.cc:205] Tried to move back new op lower bound from 7316644642561617920 to 7316644642446753792. Current Snapshot: MvccSnapshot[applied={T|T < 7316644642561617920}]
I20260809 15:43:15.965389 757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d0e64e2e96445129123ee51dcf084ca: Sending DeleteTablet for 3 replicas of tablet db14ce05798c4310b709c34bbf478c37
I20260809 15:43:15.966908 1321 tablet_service.cc:1514] Processing DeleteTablet for tablet db14ce05798c4310b709c34bbf478c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:15 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:36588
I20260809 15:43:15.967528 1505 tablet_replica.cc:330] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: stopping tablet replica
I20260809 15:43:15.967984 1505 raft_consensus.cc:2229] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:15.968060 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet db14ce05798c4310b709c34bbf478c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:15 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49976
I20260809 15:43:15.968431 1505 raft_consensus.cc:2258] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:15.968483 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet db14ce05798c4310b709c34bbf478c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:15 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49976
I20260809 15:43:15.969259 935 tablet_service.cc:1514] Processing DeleteTablet for tablet db14ce05798c4310b709c34bbf478c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:15 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:54450
I20260809 15:43:15.969403 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 810
I20260809 15:43:15.982528 1507 tablet_replica.cc:330] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: stopping tablet replica
I20260809 15:43:15.983022 1507 raft_consensus.cc:2229] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:43:15.983625 1507 raft_consensus.cc:2258] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:15.986663 1507 ts_tablet_manager.cc:1905] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:15.993377 1507 ts_tablet_manager.cc:1918] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:15.993546 1507 log.cc:1196] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/db14ce05798c4310b709c34bbf478c37
I20260809 15:43:15.994113 1507 ts_tablet_manager.cc:1939] T db14ce05798c4310b709c34bbf478c37 P ba8681c8bc0a49959947ff84ecf3cddd: Deleting consensus metadata
I20260809 15:43:15.996060 737 catalog_manager.cc:4841] TS ba8681c8bc0a49959947ff84ecf3cddd (127.14.15.130:44101): tablet db14ce05798c4310b709c34bbf478c37 (table test-table [id=cbed4b94b8954dd4ad296b8764589575]) successfully deleted
W20260809 15:43:16.003944 737 catalog_manager.cc:4808] TS ba8681c8bc0a49959947ff84ecf3cddd (127.14.15.130:44101): delete failed for tablet db14ce05798c4310b709c34bbf478c37 because the tablet was not found. No further retry: Not found: Tablet not found: db14ce05798c4310b709c34bbf478c37
I20260809 15:43:16.020174 1505 ts_tablet_manager.cc:1905] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:16.024017 1505 ts_tablet_manager.cc:1918] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:16.024173 1505 log.cc:1196] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/db14ce05798c4310b709c34bbf478c37
I20260809 15:43:16.024662 1505 ts_tablet_manager.cc:1939] T db14ce05798c4310b709c34bbf478c37 P 6f1a85d2c15a46d9bef5b0836d0b6d2e: Deleting consensus metadata
W20260809 15:43:16.025187 734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:35975 (error 108)
I20260809 15:43:16.025231 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1047
I20260809 15:43:16.042958 727 catalog_manager.cc:4841] TS 6f1a85d2c15a46d9bef5b0836d0b6d2e (127.14.15.131:45315): tablet db14ce05798c4310b709c34bbf478c37 (table test-table [id=cbed4b94b8954dd4ad296b8764589575]) successfully deleted
I20260809 15:43:16.043900 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:16.043454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:35975 (local address 127.0.0.1:54462)
0809 15:43:16.043682 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:16.043775 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:35975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260809 15:43:16.044119 734 catalog_manager.cc:4584] TS 07d8c907c8ec469ea2301f492141eb8e (127.14.15.129:35975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db14ce05798c4310b709c34bbf478c37: Network error: Client connection negotiation failed: client connection to 127.14.15.129:35975: connect: Connection refused (error 111)
I20260809 15:43:16.047955 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1238
I20260809 15:43:16.070405 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 706
I20260809 15:43:16.088327 14398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 15:43:16.433598 14398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 15:43:16.433729 14398 mini_ranger.cc:66] Stopping Ranger...
I20260809 15:43:16.779419 14398 mini_ranger.cc:68] Stopped Ranger
2026-08-09 15:43:16.779 UTC [31821] LOG: received smart shutdown request
2026-08-09 15:43:16.784 UTC [31821] LOG: background worker "logical replication launcher" (PID 31832) exited with exit code 1
2026-08-09 15:43:16.784 UTC [31826] LOG: shutting down
2026-08-09 15:43:16.961 UTC [31821] LOG: database system is shut down
2026-08-09T15:43:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53826 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:43:17 dist-test-slave-jztv krb5kdc[1528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:43:17 dist-test-slave-jztv krb5kdc[1528](info): set up 2 sockets
Aug 09 15:43:17 dist-test-slave-jztv krb5kdc[1528](info): commencing operation
krb5kdc: starting...
W20260809 15:43:18.330317 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:43:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:43:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:43:18.470386 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34587
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:18.591040 1544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:18.591323 1544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:18.591365 1544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:18.596021 1544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:18.596088 1544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:18.596108 1544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:18.596127 1544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:18.596189 1544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:18.601684 1544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:18.602916 1544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:18.604001 1544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:18.612993 1552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:18.613010 1555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:18.612988 1559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:18.613288 1544 server_base.cc:1034] running on GCE node
I20260809 15:43:18.613981 1544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:18.615221 1544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:18.616408 1544 hybrid_clock.cc:648] HybridClock initialized: now 1786290198616374 us; error 58 us; skew 500 ppm
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:18.619503 1544 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:18.620579 1544 webserver.cc:460] Webserver started at http://127.14.15.190:36907/ using document root <none> and password file <none>
I20260809 15:43:18.621496 1544 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:18.621621 1544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:18.621898 1544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:18.624120 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "a1fb378538e341cb85f5f9e2d65c82cb"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "7739250555b789d066a965ccf132f006"
server_key_iv: "f3e97ee5c406bc3b966b27602a1ee509"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.624734 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "a1fb378538e341cb85f5f9e2d65c82cb"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "7739250555b789d066a965ccf132f006"
server_key_iv: "f3e97ee5c406bc3b966b27602a1ee509"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.628705 1544 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:43:18.631273 1566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:18.632545 1544 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:43:18.632682 1544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "a1fb378538e341cb85f5f9e2d65c82cb"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "7739250555b789d066a965ccf132f006"
server_key_iv: "f3e97ee5c406bc3b966b27602a1ee509"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.632795 1544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:18.647914 1544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:18.651207 1544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:18.651423 1544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:18.659679 1544 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:34587
I20260809 15:43:18.659708 1641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:34587 every 8 connection(s)
I20260809 15:43:18.660682 1544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:18.663573 1642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:18.667465 1642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:18.668179 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1544
I20260809 15:43:18.668308 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:43:18.668591 14398 external_mini_cluster.cc:1428] Setting key 5d130f2f7f9da3fa4c834fe6db18da2c
WARNING: no policy specified for kudu/127.14.15.189@KRBTEST.COM; defaulting to no policy
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.189@KRBTEST.COM" created.
I20260809 15:43:18.684500 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.670672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.14.15.190:34587)
0809 15:43:18.671016 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:18.671028 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:18.671078 (+ 50us) server_negotiation.cc:407] Connection header received
0809 15:43:18.671617 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:18.671624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:18.671878 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:18.672101 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:18.672931 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.674478 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.675664 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.676334 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.676538 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.679274 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:18.679280 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:18.679292 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:18.679314 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:18.681088 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.681673 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.681679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.681681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.681798 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.682142 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.682145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.682147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.682604 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:18.682754 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:18.683124 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 15:43:18.683389 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
I20260809 15:43:18.684500 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.669751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34587 (local address 127.0.0.1:47670)
0809 15:43:18.670274 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.670330 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:18.671289 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:18.672123 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:18.672127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:18.672493 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:18.672760 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.672773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.674761 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.674764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.675527 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.675537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.676520 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.676523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.676688 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.677361 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:18.677377 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:18.679123 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:18.681225 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.681233 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.681244 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.681560 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.681903 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.681906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.681908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.682038 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.682724 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:18.682731 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:18.682882 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 15:43:18.683061 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 15:43:18.683451 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":153,"thread_start_us":145,"threads_started":1}
I20260809 15:43:18.687126 1642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:18.687984 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.687697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54956)
0809 15:43:18.687829 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.687913 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 15:43:18.688293 1568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
I20260809 15:43:18.689342 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.689067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54968)
0809 15:43:18.689201 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.689266 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 15:43:18.689523 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:41707: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
I20260809 15:43:18.699620 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:41707
--webserver_interface=127.14.15.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:18.738798 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } attempt: 1
I20260809 15:43:18.739797 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.739441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54974)
0809 15:43:18.739622 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.739700 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 15:43:18.740789 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.740508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54980)
0809 15:43:18.740645 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.740708 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 15:43:18.741081 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:41707: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
I20260809 15:43:18.809290 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } attempt: 2
I20260809 15:43:18.810237 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.809842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54990)
0809 15:43:18.810042 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.810119 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 15:43:18.811105 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.810857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:54992)
0809 15:43:18.810977 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.811038 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 15:43:18.811282 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:41707: Network error: Client connection negotiation failed: client connection to 127.14.15.189:41707: connect: Connection refused (error 111)
W20260809 15:43:18.822362 1652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:18.822645 1652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:18.822721 1652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:18.826862 1652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:18.826925 1652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:18.826946 1652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:18.826963 1652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:18.826979 1652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:18.832541 1652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:41707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.15.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:18.833732 1652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:18.834837 1652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:18.843978 1657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:18.843959 1660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:18.843959 1658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:18.844013 1652 server_base.cc:1034] running on GCE node
I20260809 15:43:18.844842 1652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:18.845939 1652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:18.847103 1652 hybrid_clock.cc:648] HybridClock initialized: now 1786290198847053 us; error 61 us; skew 500 ppm
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:18.849867 1652 init.cc:377] Logged in from keytab as kudu/127.14.15.189@KRBTEST.COM (short username kudu)
I20260809 15:43:18.850878 1652 webserver.cc:460] Webserver started at http://127.14.15.189:45933/ using document root <none> and password file <none>
I20260809 15:43:18.851455 1652 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:18.851548 1652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:18.851784 1652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:18.854130 1652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data/instance:
uuid: "126686d310b14aaca4300654454beda8"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "f6302f4ad9c8cac2b1719807a5dfac0a"
server_key_iv: "082960fea6fc888d88b82b99a45163d9"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.855041 1652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal/instance:
uuid: "126686d310b14aaca4300654454beda8"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "f6302f4ad9c8cac2b1719807a5dfac0a"
server_key_iv: "082960fea6fc888d88b82b99a45163d9"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.858892 1652 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:43:18.861306 1673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:18.862618 1652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:43:18.862763 1652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "126686d310b14aaca4300654454beda8"
format_stamp: "Formatted at 2026-08-09 15:43:18 on dist-test-slave-jztv"
server_key: "f6302f4ad9c8cac2b1719807a5dfac0a"
server_key_iv: "082960fea6fc888d88b82b99a45163d9"
server_key_version: "encryptionkey@0"
I20260809 15:43:18.862881 1652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:18.873371 1652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:18.876626 1652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:18.876899 1652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:18.885210 1652 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.189:41707
I20260809 15:43:18.885222 1744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.189:41707 every 8 connection(s)
I20260809 15:43:18.886200 1652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
I20260809 15:43:18.887512 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1652
I20260809 15:43:18.887629 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-1/wal/instance
I20260809 15:43:18.887943 14398 external_mini_cluster.cc:1428] Setting key dc1a0560f3e2e0e89b5bb22d8ff58620
I20260809 15:43:18.889839 1745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:18.894039 1745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.15.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.188@KRBTEST.COM" created.
I20260809 15:43:18.902483 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } attempt: 3
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:43:18.912065 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.896059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47678 (local address 127.14.15.190:34587)
0809 15:43:18.896207 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:18.896211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:18.897371 (+ 1160us) server_negotiation.cc:407] Connection header received
0809 15:43:18.898441 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:18.898444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:18.898510 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:18.898614 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:18.899849 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.900514 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.901710 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.902152 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.902352 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.905231 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:18.905236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:18.905239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:18.905272 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:18.908690 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.909359 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.909367 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.909369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.909470 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.909928 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.909931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.909933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.910132 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:18.910507 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:18.911737 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0809 15:43:18.911847 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:43:18.913615 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.903049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:55000)
0809 15:43:18.903202 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.903221 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:18.903312 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:18.904163 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:18.904166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:18.904419 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:18.904574 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.904585 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.905838 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.905844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.906816 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.906831 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.907496 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.907502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.907647 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.908181 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:18.908194 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:18.909726 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:18.911927 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.911930 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.911933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.912173 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.912511 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.912514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.912515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.912598 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.913113 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:18.913116 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:18.913206 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 15:43:18.913305 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 15:43:18.913454 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 15:43:18.913786 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.896623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34587 (local address 127.0.0.1:47678)
0809 15:43:18.897206 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.897251 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:18.898170 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:18.898786 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:18.898793 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:18.899124 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:18.899694 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.899710 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.900668 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.900671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.901571 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.901582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.902439 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.902447 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.902619 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.903384 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:18.903419 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:18.905069 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:18.908807 (+ 3738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.908818 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.908841 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.909233 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.909586 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.909590 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.909592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.909780 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.910506 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:18.910512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:18.910807 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 15:43:18.912315 (+ 1508us) client_negotiation.cc:240] Negotiation successful
0809 15:43:18.912682 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":136,"threads_started":1}
I20260809 15:43:18.913873 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.903384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55000 (local address 127.14.15.189:41707)
0809 15:43:18.903767 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:18.903775 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:18.903796 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:43:18.903832 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:18.903836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:18.903998 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:18.904176 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:18.904712 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.905662 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.906965 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.907346 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.907480 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.909893 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:18.909905 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:18.909928 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:18.909955 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:18.911812 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.912311 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.912317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.912319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.912407 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.912700 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.912703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.912705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.912989 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:18.913122 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:18.913413 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 15:43:18.913552 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":161,"threads_started":1}
I20260809 15:43:18.915294 1745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:18.915931 1642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:18.916601 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.916360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54580)
0809 15:43:18.916477 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.916529 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 15:43:18.917410 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.917111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54588)
0809 15:43:18.917248 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.917318 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 15:43:18.917586 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Aug 09 15:43:18 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
I20260809 15:43:18.922501 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:44545
--webserver_interface=127.14.15.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:18.924032 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.915881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:55004)
0809 15:43:18.915994 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.916066 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:18.916141 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:18.916440 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:18.916443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:18.916610 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:18.916726 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.916734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.917519 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.917522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.918257 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:18.918270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.918725 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.918729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:18.918821 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.919354 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:18.919375 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:18.920738 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:18.922488 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.922492 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.922494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.922731 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.923065 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:18.923067 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:18.923068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:18.923154 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:18.923630 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:18.923632 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:18.923716 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 15:43:18.923800 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:43:18.923905 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 15:43:18.924278 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.916153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55004 (local address 127.14.15.189:41707)
0809 15:43:18.916278 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:18.916281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:18.916290 (+ 9us) server_negotiation.cc:407] Connection header received
0809 15:43:18.916314 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:18.916316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:18.916346 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:18.916429 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:18.916821 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.917401 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.918372 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:18.918609 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:18.918718 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:18.920887 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:18.920890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:18.920892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:18.920911 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:18.922363 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.922841 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.922848 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.922852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.922961 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:18.923249 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:18.923255 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:18.923260 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:18.923521 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:18.923634 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:18.923907 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 15:43:18.924050 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:43:18.925139 1745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:18.925871 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.925590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54590)
0809 15:43:18.925733 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.925813 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 15:43:18.926542 1675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
I20260809 15:43:18.927495 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.927201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54598)
0809 15:43:18.927344 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.927415 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:43:18.927672 1745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
I20260809 15:43:18.948772 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 1
I20260809 15:43:18.949744 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.949414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54610)
0809 15:43:18.949597 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.949662 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 15:43:18.950585 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.950362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54612)
0809 15:43:18.950474 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.950529 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:43:18.950719 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
I20260809 15:43:18.976979 1745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 1
I20260809 15:43:18.977941 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.977580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54620)
0809 15:43:18.977754 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.977828 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 15:43:18.978785 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:18.978510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54634)
0809 15:43:18.978628 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:18.978688 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 15:43:18.978960 1745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
I20260809 15:43:19.025903 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 2
I20260809 15:43:19.026852 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.026545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54638)
0809 15:43:19.026701 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.026771 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 15:43:19.027717 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.027492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54650)
0809 15:43:19.027616 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.027664 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 15:43:19.027894 1642 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
W20260809 15:43:19.044229 1752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:19.044531 1752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:19.044598 1752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:43:19.047130 1745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 2
I20260809 15:43:19.048081 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.047733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54660)
0809 15:43:19.047910 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.047983 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 15:43:19.048929 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.048706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54668)
0809 15:43:19.048812 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.048863 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 15:43:19.049132 1745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:44545: Network error: Client connection negotiation failed: client connection to 127.14.15.188:44545: connect: Connection refused (error 111)
W20260809 15:43:19.049503 1752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:19.049556 1752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:19.049577 1752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:19.049628 1752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:19.049655 1752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:19.055557 1752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34587,127.14.15.189:41707,127.14.15.188:44545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:44545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.15.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:19.056732 1752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:19.057806 1752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:19.066529 1761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:19.066578 1766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:19.066727 1752 server_base.cc:1034] running on GCE node
W20260809 15:43:19.066578 1759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:19.067502 1752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:19.068684 1752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:19.069867 1752 hybrid_clock.cc:648] HybridClock initialized: now 1786290199069848 us; error 31 us; skew 500 ppm
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290199, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:19.073076 1752 init.cc:377] Logged in from keytab as kudu/127.14.15.188@KRBTEST.COM (short username kudu)
I20260809 15:43:19.074345 1752 webserver.cc:460] Webserver started at http://127.14.15.188:45987/ using document root <none> and password file <none>
I20260809 15:43:19.074961 1752 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:19.075028 1752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:19.075307 1752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:19.077474 1752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data/instance:
uuid: "fbd940a295bf41dba710995ae447d94c"
format_stamp: "Formatted at 2026-08-09 15:43:19 on dist-test-slave-jztv"
server_key: "28de1fa56e216e49b76babd9db754829"
server_key_iv: "7f1c1530fcbbec6590283b06f0132656"
server_key_version: "encryptionkey@0"
I20260809 15:43:19.078063 1752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal/instance:
uuid: "fbd940a295bf41dba710995ae447d94c"
format_stamp: "Formatted at 2026-08-09 15:43:19 on dist-test-slave-jztv"
server_key: "28de1fa56e216e49b76babd9db754829"
server_key_iv: "7f1c1530fcbbec6590283b06f0132656"
server_key_version: "encryptionkey@0"
I20260809 15:43:19.082414 1752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:43:19.085151 1773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:19.086586 1752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:19.086747 1752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "fbd940a295bf41dba710995ae447d94c"
format_stamp: "Formatted at 2026-08-09 15:43:19 on dist-test-slave-jztv"
server_key: "28de1fa56e216e49b76babd9db754829"
server_key_iv: "7f1c1530fcbbec6590283b06f0132656"
server_key_version: "encryptionkey@0"
I20260809 15:43:19.086884 1752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:19.106086 1752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:19.109548 1752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:19.109787 1752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:19.117662 1752 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.188:44545
I20260809 15:43:19.117683 1848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.188:44545 every 8 connection(s)
I20260809 15:43:19.118785 1752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
I20260809 15:43:19.121366 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1752
I20260809 15:43:19.121511 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786290023600843-14398-0/minicluster-data/master-2/wal/instance
I20260809 15:43:19.121797 14398 external_mini_cluster.cc:1428] Setting key 02f4358f440b44639d4181f3f15f6203
I20260809 15:43:19.122116 1851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:19.126897 1851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:19.127085 1642 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 3
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290199, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:19.139070 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.127649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54678)
0809 15:43:19.127854 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.127870 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:19.127971 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:19.128423 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:19.128427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:19.128662 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:19.128805 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.128814 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.129854 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.129859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.130680 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.130697 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.131330 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.131336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.131423 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.131965 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:19.131979 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:19.133891 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:19.136814 (+ 2923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.136821 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.136827 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.137175 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.137520 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137524 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.137526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.137662 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.138483 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:19.138486 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:19.138598 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 15:43:19.138686 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:43:19.138843 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 15:43:19.139806 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.128989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.14.15.190:34587)
0809 15:43:19.129106 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.129110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.129415 (+ 305us) server_negotiation.cc:407] Connection header received
0809 15:43:19.129605 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.129608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.129651 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.129700 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.130763 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.131234 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.132461 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.132833 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.132944 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.135776 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.135780 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.135782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.135814 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.137629 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.138161 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.138164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.138165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.138334 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.138665 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.138670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.138673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.138882 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.138954 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.139516 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.139632 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:43:19.140277 1745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } attempt: 3
I20260809 15:43:19.140705 1854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.123271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54674 (local address 127.14.15.188:44545)
0809 15:43:19.123730 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.123748 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.123786 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:43:19.124462 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.124479 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.124810 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.125171 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.126047 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.127196 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.128452 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.129860 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.130018 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.133447 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.133456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.133472 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.133510 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.136312 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137212 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.137220 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.137227 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.137377 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137749 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.137752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.137754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.138365 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.139165 (+ 800us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.139321 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.139665 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"spinlock_wait_cycles":6784,"thread_start_us":141,"threads_started":1}
I20260809 15:43:19.140699 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.127732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54678 (local address 127.14.15.188:44545)
0809 15:43:19.128196 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.128204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.128218 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:43:19.128251 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.128253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.128294 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.128385 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.128944 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.129732 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.130834 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.131189 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.131313 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.134029 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.134032 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.134035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.134064 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.136728 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137315 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.137317 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.137319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.137428 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137759 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.137763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.137765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.138362 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.139391 (+ 1029us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.139466 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.139759 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":123,"server-negotiator.queue_time_us":394,"spinlock_wait_cycles":13952,"thread_start_us":236,"threads_started":1}
I20260809 15:43:19.140699 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.128918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34587 (local address 127.0.0.1:47682)
0809 15:43:19.129295 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.129345 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:19.129498 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:19.129877 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:19.129884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:19.130434 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:19.130605 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.130615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.131390 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.131404 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.132318 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.132331 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.133019 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.133025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.133145 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.133679 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:19.133692 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:19.135628 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:19.137749 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.137759 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.137766 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.138047 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.138463 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.138468 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.138470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.138557 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.139046 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:19.139053 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:19.139219 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 15:43:19.139980 (+ 761us) client_negotiation.cc:240] Negotiation successful
0809 15:43:19.140163 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":120,"threads_started":1}
I20260809 15:43:19.142102 1851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:19.146217 1642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: Bootstrap starting.
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290199, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:43:19.149350 1642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:19.150367 1642 log.cc:824] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:19.151932 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.140817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54692)
0809 15:43:19.141093 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.141110 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:19.141198 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:19.142395 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:19.142399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:19.142640 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:19.142779 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.142791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.143769 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.143773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.144626 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.144637 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.145166 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.145170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.145260 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.146289 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:19.146307 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:19.147814 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:19.149944 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.149948 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.149950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.150390 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.150750 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.150753 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.150755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.150845 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.151304 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:19.151307 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:19.151417 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 15:43:19.151587 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 15:43:19.151732 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":2}
I20260809 15:43:19.152159 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.142650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:41707 (local address 127.0.0.1:55016)
0809 15:43:19.142744 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.142759 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:19.142831 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:19.143322 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:19.143325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:19.143499 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:19.143607 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.143614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.144707 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.144711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.145475 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.145486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.146115 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.146119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.146243 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.146749 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:19.146764 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:19.148395 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:19.150551 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.150554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.150556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.150819 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.151128 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.151131 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.151133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.151207 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.151667 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:19.151670 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:19.151763 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 15:43:19.151858 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 15:43:19.151994 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 15:43:19.152490 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.141080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54692 (local address 127.14.15.188:44545)
0809 15:43:19.142126 (+ 1046us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.142131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.142144 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:43:19.142178 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.142180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.142249 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.142906 (+ 657us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.142997 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.143647 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.144750 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.145035 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.145152 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.147965 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.147969 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.147972 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.147997 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.149829 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.150522 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.150528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.150532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.150634 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.150960 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.150963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.150964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.151195 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.152105 (+ 910us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.152180 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.152299 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":970,"spinlock_wait_cycles":768,"thread_start_us":155,"threads_started":1}
I20260809 15:43:19.152683 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.142909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.14.15.189:41707)
0809 15:43:19.143033 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.143037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.143051 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:43:19.143087 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.143090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.143132 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.143217 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.143748 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.144582 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.145606 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.145999 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.146122 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.148552 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.148556 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.148558 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.148582 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.150448 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.150945 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.150950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.150951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.151027 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.151304 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.151307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.151308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.151539 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.151621 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.152413 (+ 792us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.152531 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":46,"spinlock_wait_cycles":768}
I20260809 15:43:19.152689 1642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: No bootstrap required, opened a new log
I20260809 15:43:19.153295 1851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:43:19.156566 1745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: Bootstrap starting.
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:19.158143 1642 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.158444 1642 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:19.158501 1642 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1fb378538e341cb85f5f9e2d65c82cb, State: Initialized, Role: FOLLOWER
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290199, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
I20260809 15:43:19.159090 1642 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.160625 1642 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:19.161247 1745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:19.161382 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.161551 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:43:19.162384 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.150823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47696 (local address 127.14.15.190:34587)
0809 15:43:19.150935 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.150942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.151317 (+ 375us) server_negotiation.cc:407] Connection header received
0809 15:43:19.151360 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.151363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.151402 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.151467 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.152477 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.153173 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.154737 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.155064 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.155160 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.158345 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.158350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.158353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.158380 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.160048 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.160563 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.160567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.160569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.160665 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.161060 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.161064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.161066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.161398 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.161704 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.162049 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.162175 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":39}
I20260809 15:43:19.162348 1745 log.cc:824] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:19.163077 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.153732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:44545 (local address 127.0.0.1:54702)
0809 15:43:19.154038 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:19.154053 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:19.154129 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:19.154496 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:19.154498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:19.154656 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:19.154728 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.154734 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.155633 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.155637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.156400 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:19.156412 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.156996 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.156999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:19.157067 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.157554 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:19.157568 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:19.159072 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:19.161375 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.161378 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.161380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.161627 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.161937 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:19.161940 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:19.161942 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:19.162035 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:19.162548 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:19.162550 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:19.162633 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 15:43:19.162741 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 15:43:19.162880 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236}
I20260809 15:43:19.163653 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.153934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54702 (local address 127.14.15.188:44545)
0809 15:43:19.154281 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.154284 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.154294 (+ 10us) server_negotiation.cc:407] Connection header received
0809 15:43:19.154322 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.154324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.154357 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.154417 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.154834 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.155509 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.156524 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.156794 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.156885 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.159211 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.159215 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.159220 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.159244 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.161259 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.161720 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.161726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.161729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.161819 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.162165 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.162172 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.162175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.162417 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.162513 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.163393 (+ 880us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.163529 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260809 15:43:19.164757 1745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: No bootstrap required, opened a new log
W20260809 15:43:19.168419 1878 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:43:19.168550 1878 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:43:19.169454 1851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: Bootstrap starting.
Aug 09 15:43:19 dist-test-slave-jztv krb5kdc[1528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:43:19.171751 1745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.172017 1745 raft_consensus.cc:374] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:19.172089 1745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126686d310b14aaca4300654454beda8, State: Initialized, Role: FOLLOWER
I20260809 15:43:19.172580 1745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.172982 1851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:19.173861 1851 log.cc:824] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:19.174116 1745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:19.174572 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.163788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55018 (local address 127.14.15.189:41707)
0809 15:43:19.164232 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.164236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.164250 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:43:19.164288 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.164291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.164332 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.164419 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.165262 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.166007 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.167075 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.167443 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.167586 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.170286 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.170291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.170293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.170322 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.172067 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.172697 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.172702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.172704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.172816 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.173128 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.173131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.173135 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.173382 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.173581 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.174268 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.174399 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368}
I20260809 15:43:19.174536 1880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.174685 1880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:43:19.170565 1544 master_runner.cc:186] Error getting master registration for 127.14.15.189:41707: OK, instance_id { permanent_uuid: "126686d310b14aaca4300654454beda8" instance_seqno: 1786290198883046 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:43:19.175674 1544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:43:19.176685 1851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: No bootstrap required, opened a new log
I20260809 15:43:19.177731 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 15:43:19.182711 1895 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:43:19.182814 1895 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:43:19.185428 1851 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.186479 1851 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:19.186601 1851 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd940a295bf41dba710995ae447d94c, State: Initialized, Role: FOLLOWER
I20260809 15:43:19.187182 1851 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.188771 1851 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:19.187436 1652 master_runner.cc:186] Error getting master registration for 127.14.15.188:44545: OK, instance_id { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" instance_seqno: 1786290199115390 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:43:19.191422 1652 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:43:19.192189 1906 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.192339 1906 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: This master's current role is: FOLLOWER
W20260809 15:43:19.197103 1919 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:43:19.197196 1919 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:43:19.197939 1752 master_runner.cc:263] No leader master found from master fbd940a295bf41dba710995ae447d94c
I20260809 15:43:19.198006 1752 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:43:19.198262 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.179870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.14.15.190:34587)
0809 15:43:19.179993 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.179999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.184518 (+ 4519us) server_negotiation.cc:407] Connection header received
0809 15:43:19.184724 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.184728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.184784 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.184839 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.187204 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.187961 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.189180 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.189526 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.189606 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.192810 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.192814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.192817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.192844 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.195382 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.195910 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.195915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.195917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.196031 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.196366 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.196370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.196372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.196608 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.196745 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.197918 (+ 1173us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.198082 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:43:19.209889 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.183208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55034 (local address 127.14.15.189:41707)
0809 15:43:19.183322 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.183327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.190388 (+ 7061us) server_negotiation.cc:407] Connection header received
0809 15:43:19.191792 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.191797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.191862 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.191918 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.193218 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.193898 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.200122 (+ 6224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.200480 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.200560 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.204178 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.204183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.204186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.204221 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.206465 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.207258 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.207262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.207264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.207435 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.208717 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.208721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.208723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.209026 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.209163 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.209537 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.209687 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:43:19.215268 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:19.183888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54704 (local address 127.14.15.188:44545)
0809 15:43:19.184003 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:19.184009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:19.198876 (+ 14867us) server_negotiation.cc:407] Connection header received
0809 15:43:19.199090 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:19.199096 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:19.199145 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:19.199197 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:19.201140 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.201904 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.204596 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:19.204948 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:19.205042 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:19.211220 (+ 6178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:19.211224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:19.211227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:19.211258 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:19.213209 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.213785 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.213789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.213790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.213883 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:19.214200 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:19.214203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:19.214205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:19.214471 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:19.214589 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:19.214947 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 15:43:19.215092 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:43:19.351763 1906 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:43:19.352010 1906 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.353091 1906 leader_election.cc:288] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1fb378538e341cb85f5f9e2d65c82cb (127.14.15.190:34587), 126686d310b14aaca4300654454beda8 (127.14.15.189:41707)
I20260809 15:43:19.353938 1604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbd940a295bf41dba710995ae447d94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" is_pre_election: true
I20260809 15:43:19.354346 1604 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbd940a295bf41dba710995ae447d94c in term 0.
I20260809 15:43:19.354831 1777 leader_election.cc:302] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1fb378538e341cb85f5f9e2d65c82cb, fbd940a295bf41dba710995ae447d94c; no voters:
I20260809 15:43:19.355293 1906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:43:19.355379 1906 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:43:19.355441 1906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:19.356789 1906 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.357158 1906 leader_election.cc:288] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [CANDIDATE]: Term 1 election: Requested vote from peers a1fb378538e341cb85f5f9e2d65c82cb (127.14.15.190:34587), 126686d310b14aaca4300654454beda8 (127.14.15.189:41707)
I20260809 15:43:19.357713 1604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbd940a295bf41dba710995ae447d94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1fb378538e341cb85f5f9e2d65c82cb"
I20260809 15:43:19.357856 1604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:19.359225 1604 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbd940a295bf41dba710995ae447d94c in term 1.
I20260809 15:43:19.359602 1777 leader_election.cc:302] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1fb378538e341cb85f5f9e2d65c82cb, fbd940a295bf41dba710995ae447d94c; no voters:
I20260809 15:43:19.360224 1714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbd940a295bf41dba710995ae447d94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126686d310b14aaca4300654454beda8" is_pre_election: true
I20260809 15:43:19.360550 1714 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbd940a295bf41dba710995ae447d94c in term 0.
I20260809 15:43:19.361308 1714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbd940a295bf41dba710995ae447d94c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126686d310b14aaca4300654454beda8"
W20260809 15:43:19.361349 1784 tablet.cc:2369] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:19.361444 1714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:19.362775 1714 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbd940a295bf41dba710995ae447d94c in term 1.
I20260809 15:43:19.363636 1906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:19.363770 1906 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [term 1 LEADER]: Becoming Leader. State: Replica: fbd940a295bf41dba710995ae447d94c, State: Running, Role: LEADER
I20260809 15:43:19.364138 1906 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } }
I20260809 15:43:19.366866 1906 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd940a295bf41dba710995ae447d94c. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.367022 1906 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:19.369063 1925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:19.369887 1925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:19.375007 1714 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [term 1 FOLLOWER]: Refusing update from remote peer fbd940a295bf41dba710995ae447d94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:19.375324 1604 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [term 1 FOLLOWER]: Refusing update from remote peer fbd940a295bf41dba710995ae447d94c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:19.376048 1922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:19.376221 1906 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [LEADER]: Connected to new peer: Peer: permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:19.380904 1880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd940a295bf41dba710995ae447d94c. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.381088 1880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:43:19.381253 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd940a295bf41dba710995ae447d94c. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.381376 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: This master's current role is: FOLLOWER
W20260809 15:43:19.381596 1685 tablet.cc:2369] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:19.385624 1922 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.385794 1922 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:19.387285 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.387431 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:43:19.389605 1933 mvcc.cc:205] Tried to move back new op lower bound from 7316644656631484416 to 7316644656599625728. Current Snapshot: MvccSnapshot[applied={T|T < 7316644656631484416}]
I20260809 15:43:19.389892 1930 mvcc.cc:205] Tried to move back new op lower bound from 7316644656631484416 to 7316644656599625728. Current Snapshot: MvccSnapshot[applied={T|T < 7316644656631484416}]
I20260809 15:43:19.391875 1925 catalog_manager.cc:1347] Generated new cluster ID: 1b00b7f1ee7f4326a90573f935bea675
I20260809 15:43:19.391942 1925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:19.392117 1906 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.392226 1906 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:19.393374 1880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbd940a295bf41dba710995ae447d94c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fb378538e341cb85f5f9e2d65c82cb" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34587 } } peers { permanent_uuid: "126686d310b14aaca4300654454beda8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 41707 } } peers { permanent_uuid: "fbd940a295bf41dba710995ae447d94c" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 44545 } } }
I20260809 15:43:19.393500 1880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:43:19.395614 1931 mvcc.cc:205] Tried to move back new op lower bound from 7316644656631484416 to 7316644656599625728. Current Snapshot: MvccSnapshot[applied={T|T < 7316644656631484416}]
I20260809 15:43:19.415506 1925 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:43:19.416610 1925 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:19.430061 1925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbd940a295bf41dba710995ae447d94c: Generated new TSK 0
I20260809 15:43:19.431043 1925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:43:20.169940 1878 catalog_manager.cc:1259] Loaded cluster ID: 1b00b7f1ee7f4326a90573f935bea675
I20260809 15:43:20.170028 1878 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: loading cluster ID for follower catalog manager: success
I20260809 15:43:20.171710 1878 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: acquiring CA information for follower catalog manager: success
I20260809 15:43:20.172891 1878 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a1fb378538e341cb85f5f9e2d65c82cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:43:20.184108 1895 catalog_manager.cc:1259] Loaded cluster ID: 1b00b7f1ee7f4326a90573f935bea675
I20260809 15:43:20.184185 1895 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: loading cluster ID for follower catalog manager: success
I20260809 15:43:20.185900 1895 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: acquiring CA information for follower catalog manager: success
I20260809 15:43:20.187096 1895 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 126686d310b14aaca4300654454beda8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:43:20.499936 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1544
I20260809 15:43:20.510691 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1652
W20260809 15:43:20.526343 1776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.189:41707 (error 108)
I20260809 15:43:20.526557 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1752
2026-08-09T15:43:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3437 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:43:20 dist-test-slave-jztv krb5kdc[1947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:43:20 dist-test-slave-jztv krb5kdc[1947](info): set up 2 sockets
Aug 09 15:43:20 dist-test-slave-jztv krb5kdc[1947](info): commencing operation
krb5kdc: starting...
W20260809 15:43:21.769490 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:43:21 dist-test-slave-jztv krb5kdc[1947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:43:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:43:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:43:21.905678 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:37215
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:37215
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:22.023113 1966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:22.023445 1966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:22.023535 1966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:22.027662 1966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:22.027756 1966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:22.027796 1966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:22.027858 1966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:22.027896 1966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:22.033396 1966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:37215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:37215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:22.034650 1966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:22.035740 1966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:22.044409 1973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:22.044409 1974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:22.044620 1977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:22.044620 1966 server_base.cc:1034] running on GCE node
I20260809 15:43:22.045433 1966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:22.046591 1966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:22.047765 1966 hybrid_clock.cc:648] HybridClock initialized: now 1786290202047750 us; error 30 us; skew 500 ppm
Aug 09 15:43:22 dist-test-slave-jztv krb5kdc[1947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290202, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:22.053890 1966 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:22.054950 1966 webserver.cc:460] Webserver started at http://127.14.15.190:41655/ using document root <none> and password file <none>
I20260809 15:43:22.055547 1966 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:22.055611 1966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:22.055845 1966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:22.057968 1966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "c17845585e484745a3da3b1078e2de09"
format_stamp: "Formatted at 2026-08-09 15:43:22 on dist-test-slave-jztv"
server_key: "9fdffe0fc04f00e34478ed578dc3fa97"
server_key_iv: "5156c514ffff3f00eb9bfe9f28e84a6c"
server_key_version: "encryptionkey@0"
I20260809 15:43:22.058679 1966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "c17845585e484745a3da3b1078e2de09"
format_stamp: "Formatted at 2026-08-09 15:43:22 on dist-test-slave-jztv"
server_key: "9fdffe0fc04f00e34478ed578dc3fa97"
server_key_iv: "5156c514ffff3f00eb9bfe9f28e84a6c"
server_key_version: "encryptionkey@0"
I20260809 15:43:22.062629 1966 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:43:22.065279 1988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:22.066705 1966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:22.066862 1966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "c17845585e484745a3da3b1078e2de09"
format_stamp: "Formatted at 2026-08-09 15:43:22 on dist-test-slave-jztv"
server_key: "9fdffe0fc04f00e34478ed578dc3fa97"
server_key_iv: "5156c514ffff3f00eb9bfe9f28e84a6c"
server_key_version: "encryptionkey@0"
I20260809 15:43:22.066995 1966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:22.082122 1966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:22.085479 1966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:22.085711 1966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:22.093150 1966 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:37215
I20260809 15:43:22.093164 2062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:37215 every 8 connection(s)
I20260809 15:43:22.094204 1966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:22.097088 2066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:22.103130 2066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09: Bootstrap starting.
I20260809 15:43:22.103781 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 1966
I20260809 15:43:22.103936 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:43:22.104218 14398 external_mini_cluster.cc:1428] Setting key b5f5d425ea652ac96e52c77da7e9d0bd
I20260809 15:43:22.105994 2066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:22.106822 2066 log.cc:824] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:22.108805 2066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09: No bootstrap required, opened a new log
I20260809 15:43:22.112583 2066 raft_consensus.cc:348] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } }
I20260809 15:43:22.112867 2066 raft_consensus.cc:374] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:22.112954 2066 raft_consensus.cc:729] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17845585e484745a3da3b1078e2de09, State: Initialized, Role: FOLLOWER
Aug 09 15:43:22 dist-test-slave-jztv krb5kdc[1947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:22.113482 2066 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } }
I20260809 15:43:22.113613 2066 raft_consensus.cc:388] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:22.113700 2066 raft_consensus.cc:482] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:22.113826 2066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:22.115170 2066 raft_consensus.cc:504] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } }
I20260809 15:43:22.115541 2066 leader_election.cc:302] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c17845585e484745a3da3b1078e2de09; no voters:
I20260809 15:43:22.115943 2066 leader_election.cc:288] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:43:22.116036 2074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:22.116253 2074 raft_consensus.cc:686] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [term 1 LEADER]: Becoming Leader. State: Replica: c17845585e484745a3da3b1078e2de09, State: Running, Role: LEADER
I20260809 15:43:22.116719 2074 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } }
I20260809 15:43:22.117383 2066 sys_catalog.cc:564] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:22.118564 2075 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17845585e484745a3da3b1078e2de09. Latest consensus state: current_term: 1 leader_uuid: "c17845585e484745a3da3b1078e2de09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } } }
I20260809 15:43:22.118709 2075 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:22.119055 2076 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c17845585e484745a3da3b1078e2de09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17845585e484745a3da3b1078e2de09" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 37215 } } }
I20260809 15:43:22.119153 2076 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:22.120029 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:22.105582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.14.15.190:37215)
0809 15:43:22.106017 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:22.106035 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:22.106070 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:43:22.106844 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:22.106863 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:22.107254 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:22.107604 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:22.108462 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:22.109523 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:22.110512 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:22.111005 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:22.111202 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:22.113936 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:22.113945 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:22.113965 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:22.114000 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:22.115924 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:22.116468 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:22.116476 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:22.116484 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:22.116636 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:22.116926 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:22.116931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:22.116933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:22.117349 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:22.117598 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:22.117895 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 15:43:22.118269 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":145,"threads_started":1}
I20260809 15:43:22.120020 2086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:22.123102 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:43:22.124234 2086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:22.131114 2086 catalog_manager.cc:1347] Generated new cluster ID: 451fa5cb97194d82842efd3ecb620b28
I20260809 15:43:22.131235 2086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:22.163599 2086 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:43:22.164731 2086 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:22.171921 2086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c17845585e484745a3da3b1078e2de09: Generated new TSK 0
I20260809 15:43:22.172842 2086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:43:22.180099 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 1966
2026-08-09T15:43:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1655 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:43:22 dist-test-slave-jztv krb5kdc[2102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:43:22 dist-test-slave-jztv krb5kdc[2102](info): set up 2 sockets
Aug 09 15:43:22 dist-test-slave-jztv krb5kdc[2102](info): commencing operation
krb5kdc: starting...
W20260809 15:43:23.428318 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:43:23 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:43:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:43:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:43:23.561764 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:23.680078 2117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:23.680379 2117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:23.680459 2117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:23.684520 2117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:23.684614 2117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:23.684654 2117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:23.684713 2117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:23.684752 2117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:23.690062 2117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:23.691220 2117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:23.692278 2117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:23.701041 2123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:23.701076 2128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:23.701041 2125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:23.701454 2117 server_base.cc:1034] running on GCE node
I20260809 15:43:23.702039 2117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:23.703187 2117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:23.704353 2117 hybrid_clock.cc:648] HybridClock initialized: now 1786290203704336 us; error 31 us; skew 500 ppm
Aug 09 15:43:23 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290203, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:23.707258 2117 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:23.708179 2117 webserver.cc:460] Webserver started at http://127.14.15.190:39937/ using document root <none> and password file <none>
I20260809 15:43:23.708806 2117 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:23.708873 2117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:23.709102 2117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:23.711263 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "0af2116f90b54b289144038e2dd61a11"
format_stamp: "Formatted at 2026-08-09 15:43:23 on dist-test-slave-jztv"
server_key: "418edc4cde29b07141bc01f897600a39"
server_key_iv: "e29b266d868f39327467a5dd591a68d4"
server_key_version: "encryptionkey@0"
I20260809 15:43:23.711831 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "0af2116f90b54b289144038e2dd61a11"
format_stamp: "Formatted at 2026-08-09 15:43:23 on dist-test-slave-jztv"
server_key: "418edc4cde29b07141bc01f897600a39"
server_key_iv: "e29b266d868f39327467a5dd591a68d4"
server_key_version: "encryptionkey@0"
I20260809 15:43:23.715694 2117 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:43:23.718196 2138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:23.719650 2117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:23.719808 2117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "0af2116f90b54b289144038e2dd61a11"
format_stamp: "Formatted at 2026-08-09 15:43:23 on dist-test-slave-jztv"
server_key: "418edc4cde29b07141bc01f897600a39"
server_key_iv: "e29b266d868f39327467a5dd591a68d4"
server_key_version: "encryptionkey@0"
I20260809 15:43:23.719941 2117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:23.746300 2117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:23.749500 2117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:23.749711 2117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:23.757125 2117 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35563
I20260809 15:43:23.757434 2214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35563 every 8 connection(s)
I20260809 15:43:23.758206 2117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:23.759713 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2117
I20260809 15:43:23.759860 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:43:23.760167 14398 external_mini_cluster.cc:1428] Setting key 6ba4f666f4039a5b6b962bd2bd4a2013
I20260809 15:43:23.761446 2215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:23.768832 2215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap starting.
Aug 09 15:43:23 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:23.771727 2215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:23.772547 2215 log.cc:824] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:23.774991 2215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: No bootstrap required, opened a new log
I20260809 15:43:23.775733 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:23.761626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38718 (local address 127.14.15.190:35563)
0809 15:43:23.762068 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:23.762087 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:23.762130 (+ 43us) server_negotiation.cc:407] Connection header received
0809 15:43:23.763034 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:23.763056 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:23.763469 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:23.763854 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:23.764663 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:23.766195 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:23.767092 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:23.767830 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:23.767991 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:23.770885 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:23.770890 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:23.770903 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:23.770936 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:23.772716 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:23.773233 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:23.773242 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:23.773248 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:23.773396 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:23.773722 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:23.773725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:23.773726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:23.774123 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:23.774332 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:23.774634 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 15:43:23.774947 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":120,"threads_started":1}
I20260809 15:43:23.779177 2215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:23.779466 2215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:23.779548 2215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Initialized, Role: FOLLOWER
I20260809 15:43:23.780047 2215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:23.780200 2215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:23.780267 2215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:23.780388 2215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:23.781628 2215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:23.781996 2215 leader_election.cc:302] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0af2116f90b54b289144038e2dd61a11; no voters:
I20260809 15:43:23.782406 2215 leader_election.cc:288] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:43:23.782552 2221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:23.782840 2221 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 LEADER]: Becoming Leader. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Running, Role: LEADER
I20260809 15:43:23.783205 2221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:23.783723 2215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:23.785090 2222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:23.785107 2223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0af2116f90b54b289144038e2dd61a11. Latest consensus state: current_term: 1 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:23.785285 2222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:23.785310 2223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:23.785712 2235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:23.788635 2235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:23.794637 2235 catalog_manager.cc:1347] Generated new cluster ID: eaeb7905698e44de8b7e762c968eaaea
I20260809 15:43:23.794725 2235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:23.830482 2235 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:43:23.831544 2235 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:23.847196 2235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Generated new TSK 0
I20260809 15:43:23.848052 2235 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:43:23.894035 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:24.013332 2248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:24.013617 2248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:24.013661 2248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:24.017702 2248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:24.017768 2248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:24.017830 2248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:24.023770 2248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:24.025004 2248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:24.026050 2248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:24.036319 2253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:24.036324 2254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:24.036343 2259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:24.036473 2248 server_base.cc:1034] running on GCE node
I20260809 15:43:24.037079 2248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:24.037787 2248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:24.038980 2248 hybrid_clock.cc:648] HybridClock initialized: now 1786290204038937 us; error 51 us; skew 500 ppm
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:24.042037 2248 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:24.043187 2248 webserver.cc:460] Webserver started at http://127.14.15.129:34733/ using document root <none> and password file <none>
I20260809 15:43:24.043880 2248 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:24.043951 2248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:24.044129 2248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:24.046198 2248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "670fda4d430e46648a4df624c8986e61"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "00af9ba4669447ef9ec204711ad9a47b"
server_key_iv: "887c6ce1c4544532b729b2cf7f637f6d"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.046825 2248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "670fda4d430e46648a4df624c8986e61"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "00af9ba4669447ef9ec204711ad9a47b"
server_key_iv: "887c6ce1c4544532b729b2cf7f637f6d"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.050683 2248 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:43:24.053158 2267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.054520 2248 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:43:24.054677 2248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "670fda4d430e46648a4df624c8986e61"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "00af9ba4669447ef9ec204711ad9a47b"
server_key_iv: "887c6ce1c4544532b729b2cf7f637f6d"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.054804 2248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:24.069146 2248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:24.072664 2248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:24.072889 2248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:24.073524 2248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:24.074496 2248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:24.074577 2248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.074674 2248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:24.074726 2248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.084316 2248 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:45379
I20260809 15:43:24.084378 2426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:45379 every 8 connection(s)
I20260809 15:43:24.085373 2248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:24.092581 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2248
I20260809 15:43:24.092739 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:43:24.093042 14398 external_mini_cluster.cc:1428] Setting key 2a85b18e4cbe6dc5b4e82e5b30f38e51
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:24.100613 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.087301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:51789 (local address 127.14.15.190:35563)
0809 15:43:24.087442 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.087448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.088212 (+ 764us) server_negotiation.cc:407] Connection header received
0809 15:43:24.089641 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.089645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.089711 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.089794 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:24.090985 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.091531 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.092671 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.092994 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.093111 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.096279 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:24.096282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:24.096284 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:24.096308 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:24.098152 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.098742 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.098749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.098754 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.098857 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.099205 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.099211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.099216 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.099519 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:24.099629 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.100170 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.100340 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:43:24.101385 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.087608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:51789)
0809 15:43:24.088058 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.088102 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.089424 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.089971 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.089978 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.090350 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:24.090825 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.090839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.091665 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.091669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.092540 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.092549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.093157 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.093161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.093332 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.094037 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:24.094059 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:24.096109 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:24.098334 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.098339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.098352 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.098630 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.098958 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.098961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.098962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.099110 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.099638 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:24.099643 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:24.099902 (+ 259us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.100078 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.100433 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":108,"threads_started":1}
I20260809 15:43:24.102782 2428 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:24.103042 2428 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:24.103575 2428 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:43:24.105178 2161 ts_manager.cc:194] Registered new tserver with Master: 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379)
I20260809 15:43:24.106463 2161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:51789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:43:24.125566 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:24.242599 2433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:24.242887 2433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:24.242967 2433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:24.247118 2433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:24.247216 2433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:24.247313 2433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:24.252815 2433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:24.253978 2433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:24.255059 2433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:24.265543 2444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:24.265648 2433 server_base.cc:1034] running on GCE node
W20260809 15:43:24.265564 2443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:24.265764 2448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:24.266280 2433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:24.266961 2433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:24.268180 2433 hybrid_clock.cc:648] HybridClock initialized: now 1786290204268155 us; error 29 us; skew 500 ppm
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:24.270998 2433 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:24.271900 2433 webserver.cc:460] Webserver started at http://127.14.15.130:34339/ using document root <none> and password file <none>
I20260809 15:43:24.272428 2433 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:24.272486 2433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:24.272730 2433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:24.274933 2433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "6416c86950ac4042bcd41c69cbf3735d"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "640dd58ababb45fa73ea58a2eff8fd96"
server_key_iv: "6b2b2a59e92252d8306a053f9d5c856a"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.275516 2433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "6416c86950ac4042bcd41c69cbf3735d"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "640dd58ababb45fa73ea58a2eff8fd96"
server_key_iv: "6b2b2a59e92252d8306a053f9d5c856a"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.279603 2433 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:43:24.289108 2457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.290990 2433 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.005s sys 0.000s
I20260809 15:43:24.291162 2433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "6416c86950ac4042bcd41c69cbf3735d"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "640dd58ababb45fa73ea58a2eff8fd96"
server_key_iv: "6b2b2a59e92252d8306a053f9d5c856a"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.291320 2433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:24.312016 2433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:24.315080 2433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:24.315296 2433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:24.315935 2433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:24.316859 2433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:24.316932 2433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.317008 2433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:24.317065 2433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.327072 2433 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44125
I20260809 15:43:24.327090 2611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44125 every 8 connection(s)
I20260809 15:43:24.328069 2433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:24.329947 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2433
I20260809 15:43:24.330093 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:43:24.330435 14398 external_mini_cluster.cc:1428] Setting key 4e27ffa090916fd059c07288c5d2d7bc
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:43:24.343390 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.330082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:38277 (local address 127.14.15.190:35563)
0809 15:43:24.330268 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.330274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.331279 (+ 1005us) server_negotiation.cc:407] Connection header received
0809 15:43:24.332862 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.332868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.332936 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.333035 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:24.334301 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.334851 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.336126 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.336427 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.336518 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.339600 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:24.339604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:24.339606 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:24.339632 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:24.341099 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.341647 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.341656 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.341657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.341734 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.342141 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.342143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.342145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.342399 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:24.342505 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.343063 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.343202 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:43:24.344237 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.330556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:38277)
0809 15:43:24.331105 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.331170 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.332637 (+ 1467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.333209 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.333216 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.333597 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:24.334111 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.334125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.334992 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.334998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.335981 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.335997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.336607 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.336614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.336856 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.337533 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:24.337563 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:24.339407 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:24.341226 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.341232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.341249 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.341532 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.341828 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.341832 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.341834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.342022 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.342518 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:24.342534 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:24.342801 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.342995 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.343348 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":155,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:43:24.345643 2612 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:24.345917 2612 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:24.346541 2612 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
I20260809 15:43:24.347877 2161 ts_manager.cc:194] Registered new tserver with Master: 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125)
I20260809 15:43:24.348784 2161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:38277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:43:24.363125 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:24.485734 2618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:24.486012 2618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:24.486057 2618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:24.490073 2618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:24.490180 2618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:24.490309 2618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:24.495779 2618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:24.496805 2618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:24.497768 2618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:24.507205 2624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:24.507226 2626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:24.507222 2628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:24.507495 2618 server_base.cc:1034] running on GCE node
I20260809 15:43:24.507977 2618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:24.508652 2618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:24.509828 2618 hybrid_clock.cc:648] HybridClock initialized: now 1786290204509796 us; error 48 us; skew 500 ppm
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:24.512943 2618 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:24.513947 2618 webserver.cc:460] Webserver started at http://127.14.15.131:39603/ using document root <none> and password file <none>
I20260809 15:43:24.514619 2618 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:24.514722 2618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:24.514964 2618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:24.517102 2618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "1de47f6015d3457dac33491d718d5a6e"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "b56df965e5452716f5a5b700b60736f3"
server_key_iv: "fb661088fa5d591732f4b35647f8d3b0"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.517719 2618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "1de47f6015d3457dac33491d718d5a6e"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "b56df965e5452716f5a5b700b60736f3"
server_key_iv: "fb661088fa5d591732f4b35647f8d3b0"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.521775 2618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:43:24.524688 2636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.525928 2618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:24.526079 2618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "1de47f6015d3457dac33491d718d5a6e"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "b56df965e5452716f5a5b700b60736f3"
server_key_iv: "fb661088fa5d591732f4b35647f8d3b0"
server_key_version: "encryptionkey@0"
I20260809 15:43:24.526207 2618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:24.551944 2618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:24.555384 2618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:24.555611 2618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:24.556275 2618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:24.557154 2618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:24.557230 2618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.557304 2618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:24.557346 2618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:24.567296 2618 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:38949
I20260809 15:43:24.567318 2795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:38949 every 8 connection(s)
I20260809 15:43:24.568256 2618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:24.571779 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2618
I20260809 15:43:24.571908 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:43:24.572175 14398 external_mini_cluster.cc:1428] Setting key 9f47d34fcf6f0d3cdf8f9d2a9c2d1cd9
Aug 09 15:43:24 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290204, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:24.582813 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.570263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:48607 (local address 127.14.15.190:35563)
0809 15:43:24.570395 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.570399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.571295 (+ 896us) server_negotiation.cc:407] Connection header received
0809 15:43:24.572840 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.572844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.572904 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.573006 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:24.574648 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.575201 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.576325 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.576560 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.576648 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.579296 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:24.579300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:24.579302 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:24.579326 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:24.580624 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.581192 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.581195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.581197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.581283 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.581667 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.581670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.581671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.581866 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:24.581964 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.582567 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.582685 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:43:24.583643 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.570691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:48607)
0809 15:43:24.571138 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.571181 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.572610 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.573231 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.573241 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.573771 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:24.574466 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.574489 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.575313 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.575315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.576203 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.576213 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.576707 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.576710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.576863 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.577521 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:24.577551 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:24.579127 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:24.580748 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.580754 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.580767 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.581056 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.581390 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:24.581392 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:24.581393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:24.581537 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:24.581980 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:24.581985 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:24.582287 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.582462 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.582736 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":115,"threads_started":1}
I20260809 15:43:24.585083 2796 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:24.585392 2796 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:24.586086 2796 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
I20260809 15:43:24.587277 2161 ts_manager.cc:194] Registered new tserver with Master: 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949)
I20260809 15:43:24.587884 2161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:48607
I20260809 15:43:24.598819 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:43:24.609117 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.601219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38730 (local address 127.14.15.190:35563)
0809 15:43:24.601419 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.601423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.601489 (+ 66us) server_negotiation.cc:407] Connection header received
0809 15:43:24.601606 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.601609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.601655 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.601727 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:24.602589 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.603128 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.603943 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.604182 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.604274 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.605726 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:24.605728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:24.605730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:24.605754 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:24.607287 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.607728 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.607731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.607732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.607805 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:24.608082 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:24.608085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:24.608086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:24.608387 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:24.608546 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.608781 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.608918 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 15:43:24.612385 2161 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:43:24.615585 2161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:43:24.631703 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.625366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.14.15.131:38949)
0809 15:43:24.625786 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.625798 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.626086 (+ 288us) server_negotiation.cc:407] Connection header received
0809 15:43:24.626272 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.626277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.626481 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.626639 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:24.627144 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628250 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.630304 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.631105 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.631222 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.631371 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.631429 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.631524 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":181,"threads_started":1}
I20260809 15:43:24.631717 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.625167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:38949 (local address 127.0.0.1:44324)
0809 15:43:24.625965 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.625976 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.626105 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.626825 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.626828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.626860 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:24.627034 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.627044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628379 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.628382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.629827 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.629833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.631221 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.631224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.631306 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.631323 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.631391 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.631552 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":217,"spinlock_wait_cycles":896,"thread_start_us":108,"threads_started":1}
I20260809 15:43:24.631896 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.625514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.14.15.130:44125)
0809 15:43:24.626400 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.626411 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.626431 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:43:24.626501 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.626507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.626667 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.626808 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:24.627084 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628088 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.629932 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.630754 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.630902 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.631053 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.631636 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.631730 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":177,"threads_started":1}
I20260809 15:43:24.631928 2816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.624674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45379 (local address 127.0.0.1:44216)
0809 15:43:24.625905 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.625918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.626053 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.626556 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.626561 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.626585 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:24.626746 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.626756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628248 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.628251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.629468 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.629479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.630637 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.630641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.631576 (+ 935us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.631601 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.631677 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.631760 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":133,"thread_start_us":124,"threads_started":1}
I20260809 15:43:24.632190 2813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.624462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:44125 (local address 127.0.0.1:35952)
0809 15:43:24.624948 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.624996 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.625157 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.626783 (+ 1626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.626789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.626812 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:24.626960 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.626967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628291 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.628294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.629804 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.629816 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.631112 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.631115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.631239 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.631285 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.631394 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.631551 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":144,"spinlock_wait_cycles":1280,"thread_start_us":91,"threads_started":1}
I20260809 15:43:24.632315 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.625547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44216 (local address 127.14.15.129:45379)
0809 15:43:24.625850 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.625859 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.626017 (+ 158us) server_negotiation.cc:407] Connection header received
0809 15:43:24.626165 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.626177 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.626410 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.626573 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:24.626881 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.628113 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.629602 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.630491 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.630625 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.630784 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.632077 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.632175 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":87,"threads_started":1}
I20260809 15:43:24.635236 2331 tablet_service.cc:1467] Processing CreateTablet for tablet bf25f03620764601931ddc5429e5f7ce (DEFAULT_TABLE table=test-table [id=557de4a34cd045c29d305791709ba564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:24.635298 2700 tablet_service.cc:1467] Processing CreateTablet for tablet bf25f03620764601931ddc5429e5f7ce (DEFAULT_TABLE table=test-table [id=557de4a34cd045c29d305791709ba564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:24.635275 2518 tablet_service.cc:1467] Processing CreateTablet for tablet bf25f03620764601931ddc5429e5f7ce (DEFAULT_TABLE table=test-table [id=557de4a34cd045c29d305791709ba564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:24.636263 2331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf25f03620764601931ddc5429e5f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:24.636310 2518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf25f03620764601931ddc5429e5f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:24.636312 2700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf25f03620764601931ddc5429e5f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:24.642755 2822 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Bootstrap starting.
I20260809 15:43:24.644240 2828 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Bootstrap starting.
I20260809 15:43:24.646302 2822 tablet_bootstrap.cc:654] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:24.646302 2828 tablet_bootstrap.cc:654] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:24.646651 2824 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Bootstrap starting.
I20260809 15:43:24.647315 2822 log.cc:824] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:24.647611 2828 log.cc:824] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:24.649178 2824 tablet_bootstrap.cc:654] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:24.649595 2822 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: No bootstrap required, opened a new log
I20260809 15:43:24.649595 2828 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: No bootstrap required, opened a new log
I20260809 15:43:24.649794 2822 ts_tablet_manager.cc:1397] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260809 15:43:24.649794 2828 ts_tablet_manager.cc:1397] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 15:43:24.650100 2824 log.cc:824] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:24.651856 2824 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: No bootstrap required, opened a new log
I20260809 15:43:24.652069 2824 ts_tablet_manager.cc:1397] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:43:24.654022 2828 raft_consensus.cc:348] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.654356 2828 raft_consensus.cc:374] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:24.654456 2828 raft_consensus.cc:729] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de47f6015d3457dac33491d718d5a6e, State: Initialized, Role: FOLLOWER
I20260809 15:43:24.654369 2822 raft_consensus.cc:348] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.654623 2822 raft_consensus.cc:374] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:24.654680 2822 raft_consensus.cc:729] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670fda4d430e46648a4df624c8986e61, State: Initialized, Role: FOLLOWER
I20260809 15:43:24.655021 2828 consensus_queue.cc:260] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.655045 2822 consensus_queue.cc:260] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.655246 2824 raft_consensus.cc:348] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.655573 2824 raft_consensus.cc:374] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:24.655681 2824 raft_consensus.cc:729] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6416c86950ac4042bcd41c69cbf3735d, State: Initialized, Role: FOLLOWER
I20260809 15:43:24.656105 2828 ts_tablet_manager.cc:1428] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:43:24.656131 2428 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
I20260809 15:43:24.656144 2796 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
I20260809 15:43:24.656143 2824 consensus_queue.cc:260] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.657132 2824 ts_tablet_manager.cc:1428] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:43:24.657464 2612 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
I20260809 15:43:24.658528 2822 ts_tablet_manager.cc:1428] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260809 15:43:24.806028 2837 raft_consensus.cc:482] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:43:24.806353 2837 raft_consensus.cc:504] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.807545 2837 leader_election.cc:288] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379), 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949)
I20260809 15:43:24.812011 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.807921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45379 (local address 127.14.15.130:34373)
0809 15:43:24.808072 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.808096 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.808203 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.808529 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.808532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.808551 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:24.808681 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.808687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.809633 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.809636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.810785 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.810796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.811636 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.811639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.811744 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.811769 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.811831 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.811889 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":1}
I20260809 15:43:24.812143 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.808094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:34373 (local address 127.14.15.129:45379)
0809 15:43:24.808253 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.808258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.808277 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:43:24.808349 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.808351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.808393 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.808508 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:24.808802 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.809493 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.810942 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.811487 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.811630 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.811873 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.811935 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.812010 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 15:43:24.812866 2839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.808223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:38949 (local address 127.14.15.130:58221)
0809 15:43:24.808660 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.808670 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:24.808850 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:24.809187 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:24.809189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:24.809327 (+ 138us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:24.809447 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.809452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.810194 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.810198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.811207 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:24.811215 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.812433 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.812438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:24.812551 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.812578 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:43:24.812662 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:43:24.812735 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":134,"threads_started":1}
I20260809 15:43:24.812893 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.808436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:58221 (local address 127.14.15.131:38949)
0809 15:43:24.808579 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.808583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.808772 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:43:24.808989 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.808992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.809044 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.809124 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:24.809573 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.810075 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.811346 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.812166 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.812314 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.812374 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.812729 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.812803 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:43:24.812911 2361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf25f03620764601931ddc5429e5f7ce" candidate_uuid: "6416c86950ac4042bcd41c69cbf3735d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670fda4d430e46648a4df624c8986e61" is_pre_election: true
I20260809 15:43:24.813258 2361 raft_consensus.cc:2454] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6416c86950ac4042bcd41c69cbf3735d in term 0.
I20260809 15:43:24.813625 2730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf25f03620764601931ddc5429e5f7ce" candidate_uuid: "6416c86950ac4042bcd41c69cbf3735d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de47f6015d3457dac33491d718d5a6e" is_pre_election: true
I20260809 15:43:24.813874 2460 leader_election.cc:302] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6416c86950ac4042bcd41c69cbf3735d, 670fda4d430e46648a4df624c8986e61; no voters:
I20260809 15:43:24.813961 2730 raft_consensus.cc:2454] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6416c86950ac4042bcd41c69cbf3735d in term 0.
I20260809 15:43:24.814188 2837 raft_consensus.cc:2781] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:43:24.814339 2837 raft_consensus.cc:482] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:43:24.814402 2837 raft_consensus.cc:3037] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:24.815500 2837 raft_consensus.cc:504] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:24.815948 2837 leader_election.cc:288] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [CANDIDATE]: Term 1 election: Requested vote from peers 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379), 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949)
I20260809 15:43:24.816404 2730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf25f03620764601931ddc5429e5f7ce" candidate_uuid: "6416c86950ac4042bcd41c69cbf3735d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de47f6015d3457dac33491d718d5a6e"
I20260809 15:43:24.816444 2361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf25f03620764601931ddc5429e5f7ce" candidate_uuid: "6416c86950ac4042bcd41c69cbf3735d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670fda4d430e46648a4df624c8986e61"
I20260809 15:43:24.816548 2730 raft_consensus.cc:3037] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:24.816605 2361 raft_consensus.cc:3037] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:24.817624 2730 raft_consensus.cc:2454] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6416c86950ac4042bcd41c69cbf3735d in term 1.
I20260809 15:43:24.817757 2361 raft_consensus.cc:2454] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6416c86950ac4042bcd41c69cbf3735d in term 1.
I20260809 15:43:24.817919 2460 leader_election.cc:302] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de47f6015d3457dac33491d718d5a6e, 6416c86950ac4042bcd41c69cbf3735d; no voters:
I20260809 15:43:24.818113 2837 raft_consensus.cc:2781] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:24.818398 2837 raft_consensus.cc:686] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 1 LEADER]: Becoming Leader. State: Replica: 6416c86950ac4042bcd41c69cbf3735d, State: Running, Role: LEADER
I20260809 15:43:24.818775 2837 consensus_queue.cc:237] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
W20260809 15:43:24.819253 2797 tablet.cc:2369] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:24.822268 2160 catalog_manager.cc:5495] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130). New cstate: current_term: 1 leader_uuid: "6416c86950ac4042bcd41c69cbf3735d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } health_report { overall_health: UNKNOWN } } }
W20260809 15:43:24.829252 2613 tablet.cc:2369] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:43:24.836783 2429 tablet.cc:2369] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:24.871534 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.867601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35954 (local address 127.14.15.130:44125)
0809 15:43:24.867733 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:24.867737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:24.867749 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:43:24.867825 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:24.867828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:24.867884 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:24.867973 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:43:24.868203 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.868704 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.869895 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:24.870135 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:24.870249 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:24.870633 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:43:24.871081 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:43:24.871179 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:24.871285 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 15:43:24.871342 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:43:24.877658 2361 raft_consensus.cc:1261] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Refusing update from remote peer 6416c86950ac4042bcd41c69cbf3735d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:24.877658 2730 raft_consensus.cc:1261] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Refusing update from remote peer 6416c86950ac4042bcd41c69cbf3735d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:24.878566 2840 consensus_queue.cc:1035] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:24.878784 2837 consensus_queue.cc:1035] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [LEADER]: Connected to new peer: Peer: permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:24.886598 2843 mvcc.cc:205] Tried to move back new op lower bound from 7316644679170859008 to 7316644678941143040. Current Snapshot: MvccSnapshot[applied={T|T < 7316644679170859008}]
I20260809 15:43:24.887758 2845 mvcc.cc:205] Tried to move back new op lower bound from 7316644679170859008 to 7316644678941143040. Current Snapshot: MvccSnapshot[applied={T|T < 7316644679170859008}]
I20260809 15:43:24.895646 2160 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:24.895861 2160 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:24.898514 2160 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Sending DeleteTablet for 3 replicas of tablet bf25f03620764601931ddc5429e5f7ce
I20260809 15:43:24.899402 2518 tablet_service.cc:1514] Processing DeleteTablet for tablet bf25f03620764601931ddc5429e5f7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:24 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:35952
I20260809 15:43:24.899755 2700 tablet_service.cc:1514] Processing DeleteTablet for tablet bf25f03620764601931ddc5429e5f7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:24 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:44324
I20260809 15:43:24.900061 2856 tablet_replica.cc:330] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: stopping tablet replica
I20260809 15:43:24.900007 2331 tablet_service.cc:1514] Processing DeleteTablet for tablet bf25f03620764601931ddc5429e5f7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:24 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:44216
I20260809 15:43:24.900339 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2248
I20260809 15:43:24.906558 2857 tablet_replica.cc:330] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: stopping tablet replica
I20260809 15:43:24.907028 2857 raft_consensus.cc:2229] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:24.907507 2857 raft_consensus.cc:2258] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:24.910490 2857 ts_tablet_manager.cc:1905] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:24.913689 2857 ts_tablet_manager.cc:1918] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:24.913895 2857 log.cc:1196] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/bf25f03620764601931ddc5429e5f7ce
I20260809 15:43:24.914379 2857 ts_tablet_manager.cc:1939] T bf25f03620764601931ddc5429e5f7ce P 1de47f6015d3457dac33491d718d5a6e: Deleting consensus metadata
I20260809 15:43:24.916292 2140 catalog_manager.cc:4841] TS 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949): tablet bf25f03620764601931ddc5429e5f7ce (table test-table [id=557de4a34cd045c29d305791709ba564]) successfully deleted
I20260809 15:43:24.920873 2856 raft_consensus.cc:2229] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:43:24.921481 2856 raft_consensus.cc:2258] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:24.923214 2856 ts_tablet_manager.cc:1905] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:24.925724 2856 ts_tablet_manager.cc:1918] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:24.925853 2856 log.cc:1196] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/bf25f03620764601931ddc5429e5f7ce
I20260809 15:43:24.926169 2856 ts_tablet_manager.cc:1939] T bf25f03620764601931ddc5429e5f7ce P 6416c86950ac4042bcd41c69cbf3735d: Deleting consensus metadata
I20260809 15:43:24.927405 2139 catalog_manager.cc:4841] TS 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125): tablet bf25f03620764601931ddc5429e5f7ce (table test-table [id=557de4a34cd045c29d305791709ba564]) successfully deleted
I20260809 15:43:24.930207 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2433
W20260809 15:43:24.930312 2140 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:45379 (error 108)
I20260809 15:43:24.936461 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:24.936042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45379 (local address 127.0.0.1:44220)
0809 15:43:24.936271 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:24.936351 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:45379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260809 15:43:24.936664 2140 catalog_manager.cc:4584] TS 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bf25f03620764601931ddc5429e5f7ce: Network error: Client connection negotiation failed: client connection to 127.14.15.129:45379: connect: Connection refused (error 111)
I20260809 15:43:24.943297 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2618
I20260809 15:43:24.958287 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2117
I20260809 15:43:24.972194 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--webserver_interface=127.14.15.190
--webserver_port=39937
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:25.089562 2860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:25.089850 2860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:25.089892 2860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:25.093942 2860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:25.094013 2860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:25.094033 2860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:25.094049 2860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:25.094064 2860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:25.099611 2860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=39937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:25.100778 2860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:25.101780 2860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:43:25.116469 2860 server_base.cc:1034] running on GCE node
W20260809 15:43:25.116398 2869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.116400 2871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.116398 2868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.117424 2860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:25.118939 2860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:25.120141 2860 hybrid_clock.cc:648] HybridClock initialized: now 1786290205120121 us; error 36 us; skew 500 ppm
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:25.123474 2860 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:25.124591 2860 webserver.cc:460] Webserver started at http://127.14.15.190:39937/ using document root <none> and password file <none>
I20260809 15:43:25.125232 2860 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:25.125340 2860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:25.130064 2860 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:43:25.132627 2880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.134114 2860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:25.134334 2860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "0af2116f90b54b289144038e2dd61a11"
format_stamp: "Formatted at 2026-08-09 15:43:23 on dist-test-slave-jztv"
server_key: "418edc4cde29b07141bc01f897600a39"
server_key_iv: "e29b266d868f39327467a5dd591a68d4"
server_key_version: "encryptionkey@0"
I20260809 15:43:25.135044 2860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:25.156903 2860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:25.160270 2860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:25.160499 2860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:25.168148 2860 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35563
I20260809 15:43:25.168452 2946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35563 every 8 connection(s)
I20260809 15:43:25.169374 2860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:25.169940 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2860
I20260809 15:43:25.170465 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:45379
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=34733
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:25.174079 2947 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:43:25.176101 2947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap starting.
I20260809 15:43:25.194162 2947 log.cc:824] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:25.203362 2947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:43:25.203789 2947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap complete.
I20260809 15:43:25.208076 2947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:25.208472 2947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Initialized, Role: FOLLOWER
I20260809 15:43:25.209018 2947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:25.209146 2947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:25.209245 2947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:25.209378 2947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:43:25.211431 2947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:25.211777 2947 leader_election.cc:302] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0af2116f90b54b289144038e2dd61a11; no voters:
I20260809 15:43:25.212124 2947 leader_election.cc:288] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:43:25.212208 2952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:43:25.212409 2952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 LEADER]: Becoming Leader. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Running, Role: LEADER
I20260809 15:43:25.212777 2952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:25.213385 2947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:25.213725 2952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0af2116f90b54b289144038e2dd61a11. Latest consensus state: current_term: 2 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:25.213848 2952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:25.214242 2958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:25.214280 2954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:25.214517 2954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:25.219141 2958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:25.219884 2958 catalog_manager.cc:1259] Loaded cluster ID: eaeb7905698e44de8b7e762c968eaaea
I20260809 15:43:25.219969 2958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:25.221092 2958 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 15:43:25.223963 2958 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 15:43:25.228832 2958 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:25.229522 2958 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Loaded TSK: 0
I20260809 15:43:25.230568 2958 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:43:25.307085 2949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:25.307430 2949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:25.307548 2949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:25.311650 2949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:25.311735 2949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:25.311821 2949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:25.317811 2949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:45379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=34733
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:25.318933 2949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:25.319976 2949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:25.330677 2993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.330694 2989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.330993 2949 server_base.cc:1034] running on GCE node
W20260809 15:43:25.330694 2986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.331555 2949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:25.332355 2949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:25.333559 2949 hybrid_clock.cc:648] HybridClock initialized: now 1786290205333530 us; error 35 us; skew 500 ppm
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:25.337054 2949 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:25.338245 2949 webserver.cc:460] Webserver started at http://127.14.15.129:34733/ using document root <none> and password file <none>
I20260809 15:43:25.338989 2949 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:25.339113 2949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:25.344341 2949 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:43:25.347084 3000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.348490 2949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:43:25.348634 2949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "670fda4d430e46648a4df624c8986e61"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "00af9ba4669447ef9ec204711ad9a47b"
server_key_iv: "887c6ce1c4544532b729b2cf7f637f6d"
server_key_version: "encryptionkey@0"
I20260809 15:43:25.349202 2949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:25.360301 2949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:25.363677 2949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:25.363890 2949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:25.364502 2949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:25.365676 3010 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:43:25.371337 2949 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:43:25.371433 2949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260809 15:43:25.371549 2949 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:43:25.373226 2949 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:43:25.373301 2949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 15:43:25.373574 3010 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Bootstrap starting.
I20260809 15:43:25.384493 2949 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:45379
I20260809 15:43:25.384579 3155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:45379 every 8 connection(s)
I20260809 15:43:25.385535 2949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:25.388607 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 2949
I20260809 15:43:25.389083 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:44125
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=34339
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:25.395337 3010 log.cc:824] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:25.404156 3010 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:43:25.404338 3163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.387818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:55361)
0809 15:43:25.388567 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.388622 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.389492 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.390766 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.390774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.391212 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:25.391663 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.391679 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.392993 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.392996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.393857 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.393867 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.394733 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.394737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.394931 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.395606 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:25.395623 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:25.397764 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:25.400649 (+ 2885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.400655 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.400666 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.400997 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.401498 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.401502 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.401505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.401684 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.402554 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:25.402560 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:25.402835 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.403036 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.403357 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":176,"threads_started":1}
I20260809 15:43:25.404507 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.387835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:55361 (local address 127.14.15.190:35563)
0809 15:43:25.388257 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.388279 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.388738 (+ 459us) server_negotiation.cc:407] Connection header received
0809 15:43:25.389946 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.389959 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.390362 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.390700 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:25.391847 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.392820 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.393992 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.394585 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.394769 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.398042 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:25.398050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:25.398067 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:25.398109 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:25.400502 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.401157 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.401167 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.401175 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.401366 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.401799 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.401802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.401805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.402406 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:25.402558 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.403201 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.403558 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":138,"threads_started":1}
I20260809 15:43:25.404682 3010 tablet_bootstrap.cc:492] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Bootstrap complete.
I20260809 15:43:25.406334 3010 ts_tablet_manager.cc:1397] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.007s
I20260809 15:43:25.407414 3156 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:25.407646 3156 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:25.408201 3156 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
I20260809 15:43:25.409771 3010 raft_consensus.cc:348] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:25.410723 3010 raft_consensus.cc:729] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670fda4d430e46648a4df624c8986e61, State: Initialized, Role: FOLLOWER
I20260809 15:43:25.411064 2902 ts_manager.cc:194] Registered new tserver with Master: 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379)
I20260809 15:43:25.411294 3010 consensus_queue.cc:260] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } } peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } }
I20260809 15:43:25.412834 3010 ts_tablet_manager.cc:1428] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:43:25.415745 2902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:55361
I20260809 15:43:25.418607 3156 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:43:25.426679 3172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.414666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45379 (local address 127.0.0.1:37492)
0809 15:43:25.415128 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.415174 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.415303 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.417213 (+ 1910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.417219 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.417675 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:25.417811 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.417820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.419283 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.419287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.419948 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.419958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.420673 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.420676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.420798 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.421387 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:25.421399 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:25.422948 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:25.424814 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.424823 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.424829 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.425074 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.425397 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.425400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.425402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.425491 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.425964 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:25.425970 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:25.426103 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.426283 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.426488 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":193,"threads_started":1}
I20260809 15:43:25.426723 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.414727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37492 (local address 127.14.15.129:45379)
0809 15:43:25.416693 (+ 1966us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.416706 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.416738 (+ 32us) server_negotiation.cc:407] Connection header received
0809 15:43:25.416811 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.416817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.417033 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.417180 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:25.417973 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.419155 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.420089 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.420548 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.420668 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.423108 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:25.423117 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:25.423127 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:25.423150 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:25.424695 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.425212 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.425217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.425218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.425299 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.425587 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.425591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.425593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.425835 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:25.425973 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.426399 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.426576 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1861,"thread_start_us":149,"threads_started":1}
I20260809 15:43:25.428331 3065 tablet_service.cc:1514] Processing DeleteTablet for tablet bf25f03620764601931ddc5429e5f7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:24 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37492
I20260809 15:43:25.429266 3174 tablet_replica.cc:330] stopping tablet replica
I20260809 15:43:25.429603 3174 raft_consensus.cc:2229] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:25.429878 3174 raft_consensus.cc:2258] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:25.431077 3174 ts_tablet_manager.cc:1905] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:25.435858 3174 ts_tablet_manager.cc:1918] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:25.435987 3174 log.cc:1196] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/bf25f03620764601931ddc5429e5f7ce
I20260809 15:43:25.436295 3174 ts_tablet_manager.cc:1939] T bf25f03620764601931ddc5429e5f7ce P 670fda4d430e46648a4df624c8986e61: Deleting consensus metadata
I20260809 15:43:25.438565 2883 catalog_manager.cc:4841] TS 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379): tablet bf25f03620764601931ddc5429e5f7ce (table test-table [id=557de4a34cd045c29d305791709ba564]) successfully deleted
W20260809 15:43:25.518785 3164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:25.519059 3164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:25.519146 3164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:25.523239 3164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:25.523300 3164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:25.523391 3164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:25.528699 3164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:44125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=34339
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:25.529722 3164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:25.530793 3164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:25.540669 3180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.540705 3186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.540728 3181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.541044 3164 server_base.cc:1034] running on GCE node
I20260809 15:43:25.541460 3164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:25.542054 3164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:25.543228 3164 hybrid_clock.cc:648] HybridClock initialized: now 1786290205543196 us; error 45 us; skew 500 ppm
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:25.546131 3164 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:25.547048 3164 webserver.cc:460] Webserver started at http://127.14.15.130:34339/ using document root <none> and password file <none>
I20260809 15:43:25.547603 3164 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:25.547678 3164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:25.551582 3164 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:43:25.553808 3195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.555243 3164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:25.555414 3164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "6416c86950ac4042bcd41c69cbf3735d"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "640dd58ababb45fa73ea58a2eff8fd96"
server_key_iv: "6b2b2a59e92252d8306a053f9d5c856a"
server_key_version: "encryptionkey@0"
I20260809 15:43:25.555986 3164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:25.568902 3164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:25.572243 3164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:25.572486 3164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:25.573101 3164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:25.573962 3164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:25.574046 3164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.574146 3164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:25.574198 3164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.583305 3164 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44125
I20260809 15:43:25.583330 3361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44125 every 8 connection(s)
I20260809 15:43:25.584342 3164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:25.589850 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 3164
I20260809 15:43:25.590409 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:38949
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=39603
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:25.601191 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.586510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:58285 (local address 127.14.15.190:35563)
0809 15:43:25.586678 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.586682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.587564 (+ 882us) server_negotiation.cc:407] Connection header received
0809 15:43:25.588978 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.588981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.589038 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.589136 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:25.590747 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.591290 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.592862 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.593275 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.593419 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.596238 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:25.596245 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:25.596250 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:25.596292 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:25.598115 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.598816 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.598823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.598827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.598946 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.599328 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.599334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.599338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.599810 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:25.599946 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.600631 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.600935 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 15:43:25.602310 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.586910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:58285)
0809 15:43:25.587399 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.587442 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.588726 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.589307 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.589313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.589818 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:25.590586 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.590614 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.591453 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.591460 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.592722 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.592732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.593437 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.593440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.593585 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.594255 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:25.594281 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:25.596031 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:25.598340 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.598346 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.598371 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.598683 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.599047 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.599050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.599051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.599205 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.599997 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:25.600006 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:25.600306 (+ 300us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.600498 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.601113 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":124,"threads_started":1}
I20260809 15:43:25.604080 3362 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:25.604416 3362 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:25.605158 3362 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
I20260809 15:43:25.606555 2902 ts_manager.cc:194] Registered new tserver with Master: 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125)
I20260809 15:43:25.607342 2902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:58285
W20260809 15:43:25.714813 3367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:25.715106 3367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:25.715153 3367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:25.719431 3367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:25.719511 3367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:25.719604 3367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:25.725186 3367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:38949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=39603
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:25.726444 3367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:25.727531 3367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:25.737746 3375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.737902 3367 server_base.cc:1034] running on GCE node
W20260809 15:43:25.737775 3377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:25.737773 3381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:25.738634 3367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:25.739257 3367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:25.740418 3367 hybrid_clock.cc:648] HybridClock initialized: now 1786290205740382 us; error 50 us; skew 500 ppm
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:25.743373 3367 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:25.744314 3367 webserver.cc:460] Webserver started at http://127.14.15.131:39603/ using document root <none> and password file <none>
I20260809 15:43:25.744911 3367 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:25.745036 3367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:25.749155 3367 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:25.751526 3393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.752905 3367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:43:25.753069 3367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "1de47f6015d3457dac33491d718d5a6e"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "b56df965e5452716f5a5b700b60736f3"
server_key_iv: "fb661088fa5d591732f4b35647f8d3b0"
server_key_version: "encryptionkey@0"
I20260809 15:43:25.753726 3367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:25.770334 3367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:25.773488 3367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:25.773802 3367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:25.774452 3367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:25.775317 3367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:25.775395 3367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.775467 3367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:25.775511 3367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:25.784812 3367 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:38949
I20260809 15:43:25.784843 3549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:38949 every 8 connection(s)
I20260809 15:43:25.785825 3367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:25.789067 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 3367
Aug 09 15:43:25 dist-test-slave-jztv krb5kdc[2102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290205, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:25.798609 3559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.789808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46986 (local address 127.14.15.190:35563)
0809 15:43:25.790048 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.790051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.790182 (+ 131us) server_negotiation.cc:407] Connection header received
0809 15:43:25.790332 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.790335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.790382 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.790490 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:25.791485 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.792021 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.792980 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.793203 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.793279 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.794877 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:25.794880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:25.794882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:25.794907 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:25.796612 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.797112 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.797115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.797116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.797225 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.797503 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.797509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.797514 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.797782 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:25.798036 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.798207 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.798387 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
I20260809 15:43:25.801165 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.787823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:59585 (local address 127.14.15.190:35563)
0809 15:43:25.788019 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.788024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.788935 (+ 911us) server_negotiation.cc:407] Connection header received
0809 15:43:25.790782 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.790784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.790815 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.790863 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:25.792229 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.792687 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.794268 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.794511 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.794604 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.797239 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:25.797245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:25.797251 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:25.797279 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:25.798894 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.799558 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.799561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.799563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.799651 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:25.800014 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:25.800018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:25.800020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:25.800216 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:25.800323 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.800906 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.801017 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 15:43:25.802064 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.788271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:59585)
0809 15:43:25.788722 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.788801 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.790564 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.791094 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.791104 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.791589 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:25.792061 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.792103 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.792819 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.792823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.794075 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.794089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.794680 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.794684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.794909 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.795519 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:25.795538 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:25.797080 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:25.799044 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.799050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.799067 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.799458 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.799774 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:25.799776 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:25.799777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:25.799910 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:25.800324 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:25.800331 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:25.800646 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.800862 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.801205 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":121,"threads_started":1}
I20260809 15:43:25.803211 3550 heartbeater.cc:347] Connected to a master server at 127.14.15.190:35563
I20260809 15:43:25.803431 3550 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:25.803876 3550 heartbeater.cc:511] Master 127.14.15.190:35563 requested a full tablet report, sending...
I20260809 15:43:25.804852 2902 ts_manager.cc:194] Registered new tserver with Master: 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949)
I20260809 15:43:25.805460 2902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:59585
I20260809 15:43:25.812479 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:43:25.817233 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.813095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46996 (local address 127.14.15.190:35563)
0809 15:43:25.813235 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.813240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.813489 (+ 249us) server_negotiation.cc:407] Connection header received
0809 15:43:25.813693 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.813695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.813800 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.813920 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:43:25.814191 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.814868 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.815795 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.816000 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.816098 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.816406 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:43:25.816835 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:43:25.816942 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.817068 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.817121 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:43:25.817924 2902 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:46996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:43:25.821300 2902 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:43:25.829845 3065 tablet_service.cc:1467] Processing CreateTablet for tablet 552bf073dba0420fac0de1a5631a6c45 (DEFAULT_TABLE table=test-table [id=99d04f88298349da9d9afa3d150c6084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:25.830644 3065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552bf073dba0420fac0de1a5631a6c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:25.833534 3010 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Bootstrap starting.
I20260809 15:43:25.834327 3172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.828371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:38949 (local address 127.0.0.1:59052)
0809 15:43:25.828500 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.828516 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.828600 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.829633 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.829636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.829656 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:25.829778 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.829785 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.831462 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.831466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.832780 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.832791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.833809 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.833813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.833919 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.833981 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.834066 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.834157 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":65}
I20260809 15:43:25.834553 3010 tablet_bootstrap.cc:654] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:25.834630 3567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.828570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59052 (local address 127.14.15.131:38949)
0809 15:43:25.828999 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.829014 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.829039 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:43:25.829123 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.829129 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.829354 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.829668 (+ 314us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:25.829908 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.831277 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.832908 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.833701 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.833807 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.833958 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.834101 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.834200 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":165,"threads_started":1}
I20260809 15:43:25.834647 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.828696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:44125 (local address 127.0.0.1:54690)
0809 15:43:25.828942 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.828955 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.829043 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.830084 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.830089 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.830110 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:25.830202 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.830207 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.831813 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.831816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.832917 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.832927 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.834206 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.834233 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.834318 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.834347 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.834423 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.834506 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":22,"thread_start_us":110,"threads_started":1}
I20260809 15:43:25.835171 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.829146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54690 (local address 127.14.15.130:44125)
0809 15:43:25.829632 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.829643 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.829667 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:43:25.829738 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.829743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.829927 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.830105 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:25.830334 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.831668 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.833069 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.833886 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.833988 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.834145 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.834886 (+ 741us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.834982 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":178,"threads_started":1}
I20260809 15:43:25.836437 3010 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: No bootstrap required, opened a new log
I20260809 15:43:25.836536 3010 ts_tablet_manager.cc:1397] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:25.837001 3010 raft_consensus.cc:348] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.837121 3010 raft_consensus.cc:374] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:25.837159 3010 raft_consensus.cc:729] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670fda4d430e46648a4df624c8986e61, State: Initialized, Role: FOLLOWER
I20260809 15:43:25.837291 3010 consensus_queue.cc:260] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.837551 3010 ts_tablet_manager.cc:1428] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:43:25.837996 3264 tablet_service.cc:1467] Processing CreateTablet for tablet 552bf073dba0420fac0de1a5631a6c45 (DEFAULT_TABLE table=test-table [id=99d04f88298349da9d9afa3d150c6084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:25.838016 3454 tablet_service.cc:1467] Processing CreateTablet for tablet 552bf073dba0420fac0de1a5631a6c45 (DEFAULT_TABLE table=test-table [id=99d04f88298349da9d9afa3d150c6084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:25.839135 3264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552bf073dba0420fac0de1a5631a6c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:25.839238 3454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552bf073dba0420fac0de1a5631a6c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:25.846405 3573 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Bootstrap starting.
I20260809 15:43:25.846405 3574 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Bootstrap starting.
I20260809 15:43:25.848483 3573 tablet_bootstrap.cc:654] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:25.848891 3574 tablet_bootstrap.cc:654] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:25.849627 3574 log.cc:824] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:25.849627 3573 log.cc:824] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:25.851655 3574 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: No bootstrap required, opened a new log
I20260809 15:43:25.851670 3573 tablet_bootstrap.cc:492] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: No bootstrap required, opened a new log
I20260809 15:43:25.851856 3574 ts_tablet_manager.cc:1397] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:43:25.851866 3573 ts_tablet_manager.cc:1397] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:43:25.855337 3573 raft_consensus.cc:348] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.855264 3574 raft_consensus.cc:348] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.855597 3573 raft_consensus.cc:374] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:25.855646 3574 raft_consensus.cc:374] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:25.855661 3573 raft_consensus.cc:729] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de47f6015d3457dac33491d718d5a6e, State: Initialized, Role: FOLLOWER
I20260809 15:43:25.855718 3574 raft_consensus.cc:729] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6416c86950ac4042bcd41c69cbf3735d, State: Initialized, Role: FOLLOWER
I20260809 15:43:25.856138 3573 consensus_queue.cc:260] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.856149 3574 consensus_queue.cc:260] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.857053 3362 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
I20260809 15:43:25.857218 3573 ts_tablet_manager.cc:1428] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:43:25.857228 3574 ts_tablet_manager.cc:1428] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:43:25.857571 3550 heartbeater.cc:503] Master 127.14.15.190:35563 was elected leader, sending a full tablet report...
I20260809 15:43:25.861575 3583 raft_consensus.cc:482] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:43:25.861713 3583 raft_consensus.cc:504] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.862807 3583 leader_election.cc:288] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125), 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379)
I20260809 15:43:25.866905 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.863185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:58367 (local address 127.14.15.130:44125)
0809 15:43:25.863313 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.863318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.863511 (+ 193us) server_negotiation.cc:407] Connection header received
0809 15:43:25.863654 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.863657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.863701 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.863779 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:25.864123 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.864734 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.865843 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.866323 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.866454 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.866508 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.866690 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.866761 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:43:25.866918 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.863435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:52067 (local address 127.14.15.129:45379)
0809 15:43:25.863572 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.863575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.863586 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:43:25.863631 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.863634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.863684 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.863792 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:25.864158 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.864714 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.865838 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.866364 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.866509 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.866675 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.866716 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.866788 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:43:25.866935 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.863013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45379 (local address 127.14.15.131:52067)
0809 15:43:25.863303 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.863319 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.863405 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.863803 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.863807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.863851 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:25.864014 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.864022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.864835 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.864840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.865706 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.865716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.866497 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.866501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.866603 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.866624 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.866692 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.866775 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":46,"spinlock_wait_cycles":6912}
I20260809 15:43:25.866961 3584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.863013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:44125 (local address 127.14.15.131:58367)
0809 15:43:25.863415 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:25.863426 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:25.863552 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:25.863802 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:25.863804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:25.863849 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:25.864005 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.864011 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.864850 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.864855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.865714 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:25.865724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.866448 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.866452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:25.866550 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.866574 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:43:25.866675 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 15:43:25.866753 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":147,"spinlock_wait_cycles":34048,"thread_start_us":126,"threads_started":1}
I20260809 15:43:25.867596 3293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552bf073dba0420fac0de1a5631a6c45" candidate_uuid: "1de47f6015d3457dac33491d718d5a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6416c86950ac4042bcd41c69cbf3735d" is_pre_election: true
I20260809 15:43:25.867597 3088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552bf073dba0420fac0de1a5631a6c45" candidate_uuid: "1de47f6015d3457dac33491d718d5a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670fda4d430e46648a4df624c8986e61" is_pre_election: true
I20260809 15:43:25.867894 3088 raft_consensus.cc:2454] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de47f6015d3457dac33491d718d5a6e in term 0.
I20260809 15:43:25.867914 3293 raft_consensus.cc:2454] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de47f6015d3457dac33491d718d5a6e in term 0.
I20260809 15:43:25.868407 3396 leader_election.cc:302] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1de47f6015d3457dac33491d718d5a6e, 6416c86950ac4042bcd41c69cbf3735d, 670fda4d430e46648a4df624c8986e61; no voters:
I20260809 15:43:25.868698 3583 raft_consensus.cc:2781] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:43:25.868782 3583 raft_consensus.cc:482] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:43:25.868813 3583 raft_consensus.cc:3037] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:25.869966 3583 raft_consensus.cc:504] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.870409 3583 leader_election.cc:288] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [CANDIDATE]: Term 1 election: Requested vote from peers 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125), 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379)
I20260809 15:43:25.870764 3293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552bf073dba0420fac0de1a5631a6c45" candidate_uuid: "1de47f6015d3457dac33491d718d5a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6416c86950ac4042bcd41c69cbf3735d"
I20260809 15:43:25.870795 3088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552bf073dba0420fac0de1a5631a6c45" candidate_uuid: "1de47f6015d3457dac33491d718d5a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670fda4d430e46648a4df624c8986e61"
I20260809 15:43:25.870908 3293 raft_consensus.cc:3037] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:25.870925 3088 raft_consensus.cc:3037] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:25.871973 3088 raft_consensus.cc:2454] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de47f6015d3457dac33491d718d5a6e in term 1.
I20260809 15:43:25.872009 3293 raft_consensus.cc:2454] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de47f6015d3457dac33491d718d5a6e in term 1.
I20260809 15:43:25.872282 3397 leader_election.cc:302] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de47f6015d3457dac33491d718d5a6e, 670fda4d430e46648a4df624c8986e61; no voters:
I20260809 15:43:25.872478 3583 raft_consensus.cc:2781] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:25.872762 3583 raft_consensus.cc:686] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 1 LEADER]: Becoming Leader. State: Replica: 1de47f6015d3457dac33491d718d5a6e, State: Running, Role: LEADER
I20260809 15:43:25.873137 3583 consensus_queue.cc:237] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } }
I20260809 15:43:25.878192 2901 catalog_manager.cc:5495] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de47f6015d3457dac33491d718d5a6e (127.14.15.131). New cstate: current_term: 1 leader_uuid: "1de47f6015d3457dac33491d718d5a6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de47f6015d3457dac33491d718d5a6e" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 38949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 } health_report { overall_health: UNKNOWN } } }
W20260809 15:43:25.886747 3161 tablet.cc:2369] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:43:25.891994 3567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:25.888469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59056 (local address 127.14.15.131:38949)
0809 15:43:25.888607 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:25.888610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:25.888625 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:43:25.888780 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:25.888783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:25.888836 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:25.888923 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:43:25.889113 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.889599 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.890557 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:25.890795 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:25.890892 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:25.891185 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:43:25.891643 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:43:25.891738 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:25.891817 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 15:43:25.891876 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:43:25.898525 3088 raft_consensus.cc:1261] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Refusing update from remote peer 1de47f6015d3457dac33491d718d5a6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:25.898535 3293 raft_consensus.cc:1261] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Refusing update from remote peer 1de47f6015d3457dac33491d718d5a6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:25.899297 3586 consensus_queue.cc:1035] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "670fda4d430e46648a4df624c8986e61" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:25.899520 3583 consensus_queue.cc:1035] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6416c86950ac4042bcd41c69cbf3735d" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:25.909880 3593 mvcc.cc:205] Tried to move back new op lower bound from 7316644683352092672 to 7316644683259146240. Current Snapshot: MvccSnapshot[applied={T|T < 7316644683352092672}]
I20260809 15:43:25.915164 2902 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:46996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:25.915360 2902 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:46996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:25.917728 2902 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Sending DeleteTablet for 3 replicas of tablet 552bf073dba0420fac0de1a5631a6c45
I20260809 15:43:25.918493 3065 tablet_service.cc:1514] Processing DeleteTablet for tablet 552bf073dba0420fac0de1a5631a6c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:25 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:37492
I20260809 15:43:25.918702 3174 tablet_replica.cc:330] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: stopping tablet replica
I20260809 15:43:25.918658 3264 tablet_service.cc:1514] Processing DeleteTablet for tablet 552bf073dba0420fac0de1a5631a6c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:25 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:54690
I20260809 15:43:25.918821 3174 raft_consensus.cc:2229] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:25.918965 3174 raft_consensus.cc:2258] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:25.919222 3607 tablet_replica.cc:330] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: stopping tablet replica
I20260809 15:43:25.919579 3607 raft_consensus.cc:2229] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:25.919545 3454 tablet_service.cc:1514] Processing DeleteTablet for tablet 552bf073dba0420fac0de1a5631a6c45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:25 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:59052
I20260809 15:43:25.919924 3607 raft_consensus.cc:2258] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:25.920199 3174 ts_tablet_manager.cc:1905] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:25.920128 3609 tablet_replica.cc:330] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: stopping tablet replica
I20260809 15:43:25.920599 3609 raft_consensus.cc:2229] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:43:25.921036 3609 raft_consensus.cc:2258] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:25.921607 3607 ts_tablet_manager.cc:1905] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:25.922571 3609 ts_tablet_manager.cc:1905] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:25.922917 3174 ts_tablet_manager.cc:1918] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:25.923007 3174 log.cc:1196] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/552bf073dba0420fac0de1a5631a6c45
I20260809 15:43:25.923308 3174 ts_tablet_manager.cc:1939] T 552bf073dba0420fac0de1a5631a6c45 P 670fda4d430e46648a4df624c8986e61: Deleting consensus metadata
I20260809 15:43:25.924062 2883 catalog_manager.cc:4841] TS 670fda4d430e46648a4df624c8986e61 (127.14.15.129:45379): tablet 552bf073dba0420fac0de1a5631a6c45 (table test-table [id=99d04f88298349da9d9afa3d150c6084]) successfully deleted
I20260809 15:43:25.924424 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2949
I20260809 15:43:25.924418 3607 ts_tablet_manager.cc:1918] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:25.925920 3609 ts_tablet_manager.cc:1918] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:25.926065 3609 log.cc:1196] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/552bf073dba0420fac0de1a5631a6c45
I20260809 15:43:25.926446 3609 ts_tablet_manager.cc:1939] T 552bf073dba0420fac0de1a5631a6c45 P 1de47f6015d3457dac33491d718d5a6e: Deleting consensus metadata
I20260809 15:43:25.924535 3607 log.cc:1196] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/552bf073dba0420fac0de1a5631a6c45
I20260809 15:43:25.927902 3607 ts_tablet_manager.cc:1939] T 552bf073dba0420fac0de1a5631a6c45 P 6416c86950ac4042bcd41c69cbf3735d: Deleting consensus metadata
I20260809 15:43:25.928922 2881 catalog_manager.cc:4841] TS 6416c86950ac4042bcd41c69cbf3735d (127.14.15.130:44125): tablet 552bf073dba0420fac0de1a5631a6c45 (table test-table [id=99d04f88298349da9d9afa3d150c6084]) successfully deleted
I20260809 15:43:25.930475 2883 catalog_manager.cc:4841] TS 1de47f6015d3457dac33491d718d5a6e (127.14.15.131:38949): tablet 552bf073dba0420fac0de1a5631a6c45 (table test-table [id=99d04f88298349da9d9afa3d150c6084]) successfully deleted
I20260809 15:43:25.936962 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 3164
I20260809 15:43:25.955538 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 3367
I20260809 15:43:25.968401 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 2860
I20260809 15:43:25.980476 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--webserver_interface=127.14.15.190
--webserver_port=39937
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:26.094560 3610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:26.094900 3610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:26.094983 3610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:26.099074 3610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:26.099171 3610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:26.099213 3610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:26.099273 3610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:26.099310 3610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:26.104769 3610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=39937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:26.105949 3610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:26.107059 3610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:26.115670 3622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.115795 3610 server_base.cc:1034] running on GCE node
W20260809 15:43:26.115691 3618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.115720 3617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.116534 3610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:26.117662 3610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:26.118852 3610 hybrid_clock.cc:648] HybridClock initialized: now 1786290206118845 us; error 34 us; skew 500 ppm
Aug 09 15:43:26 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290206, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:26.121855 3610 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:26.122936 3610 webserver.cc:460] Webserver started at http://127.14.15.190:39937/ using document root <none> and password file <none>
I20260809 15:43:26.123540 3610 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:26.123641 3610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:26.127688 3610 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:43:26.130386 3642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.131807 3610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:26.131968 3610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "0af2116f90b54b289144038e2dd61a11"
format_stamp: "Formatted at 2026-08-09 15:43:23 on dist-test-slave-jztv"
server_key: "418edc4cde29b07141bc01f897600a39"
server_key_iv: "e29b266d868f39327467a5dd591a68d4"
server_key_version: "encryptionkey@0"
I20260809 15:43:26.132570 3610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:26.154937 3610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:26.158569 3610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:26.158793 3610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:26.166553 3610 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35563
I20260809 15:43:26.166841 3715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35563 every 8 connection(s)
I20260809 15:43:26.167845 3610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:26.172326 3716 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:43:26.174093 3716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap starting.
I20260809 15:43:26.177767 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 3610
I20260809 15:43:26.178318 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:45379
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=34733
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:43:26.193100 3716 log.cc:824] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:26.205884 3716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:43:26.206557 3716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11: Bootstrap complete.
I20260809 15:43:26.211228 3716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:26.211874 3716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Initialized, Role: FOLLOWER
I20260809 15:43:26.212466 3716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:26.212630 3716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:26.212728 3716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:26.212853 3716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:43:26.215021 3716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:26.215396 3716 leader_election.cc:302] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0af2116f90b54b289144038e2dd61a11; no voters:
I20260809 15:43:26.215807 3716 leader_election.cc:288] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 15:43:26.215888 3721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:43:26.216130 3721 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [term 3 LEADER]: Becoming Leader. State: Replica: 0af2116f90b54b289144038e2dd61a11, State: Running, Role: LEADER
I20260809 15:43:26.216460 3721 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } }
I20260809 15:43:26.217228 3716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:26.217917 3722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:26.218400 3722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:26.218294 3723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0af2116f90b54b289144038e2dd61a11. Latest consensus state: current_term: 3 leader_uuid: "0af2116f90b54b289144038e2dd61a11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af2116f90b54b289144038e2dd61a11" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35563 } } }
I20260809 15:43:26.218755 3723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af2116f90b54b289144038e2dd61a11 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:26.219074 3732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:26.224687 3732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:26.225481 3732 catalog_manager.cc:1259] Loaded cluster ID: eaeb7905698e44de8b7e762c968eaaea
I20260809 15:43:26.225560 3732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 15:43:26.226692 3732 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5f6dd869ad google::LogMessage::Fail() at ??:0
@ 0x7f5f6dd8988a google::LogMessage::SendToLog() at ??:0
@ 0x7f5f6dd864de google::LogMessage::Flush() at ??:0
@ 0x7f5f6dd87a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5f786c9fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f5f786cad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5f786c7579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f5f7870b640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5f6ffd83d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5f6ffd8c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f5f6ffda3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5f6ffc9512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5f7160d6db start_thread at ??:0
@ 0x7f5f6c88461f clone at ??:0
W20260809 15:43:26.347352 3718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:26.347751 3718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:26.347834 3718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:26.354051 3718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:26.354141 3718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:26.354254 3718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:26.362790 3718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:45379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=34733
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:26.364265 3718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:26.365624 3718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:26.377185 3772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.377240 3770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.377440 3776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.377517 3718 server_base.cc:1034] running on GCE node
I20260809 15:43:26.377952 3718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:26.378646 3718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:26.379843 3718 hybrid_clock.cc:648] HybridClock initialized: now 1786290206379815 us; error 45 us; skew 500 ppm
Aug 09 15:43:26 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290206, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:26.382799 3718 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:26.383730 3718 webserver.cc:460] Webserver started at http://127.14.15.129:34733/ using document root <none> and password file <none>
I20260809 15:43:26.384313 3718 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:26.384411 3718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:26.388698 3718 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:43:26.391069 3787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.392665 3718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:43:26.392822 3718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "670fda4d430e46648a4df624c8986e61"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "00af9ba4669447ef9ec204711ad9a47b"
server_key_iv: "887c6ce1c4544532b729b2cf7f637f6d"
server_key_version: "encryptionkey@0"
I20260809 15:43:26.393419 3718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:26.422358 3718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:26.425769 3718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:26.426002 3718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:26.426698 3718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:26.427573 3718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:26.427649 3718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.427722 3718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:26.427774 3718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.439121 3718 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:45379
I20260809 15:43:26.439150 3933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:45379 every 8 connection(s)
I20260809 15:43:26.440191 3718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:26.448472 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 3718
I20260809 15:43:26.448940 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:44125
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=34339
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:26.469942 3939 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:43:26.442579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:58463)
0809 15:43:26.443173 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.443232 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:26.444912 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:26.468977 (+ 24065us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":122,"threads_started":1}
W20260809 15:43:26.470568 3934 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:35563 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:35563: Client connection negotiation failed: client connection to 127.14.15.190:35563: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:43:26.471359 3939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.471098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:44489)
0809 15:43:26.471234 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.471300 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 15:43:26.472039 3939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.471829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:37547)
0809 15:43:26.471937 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.471985 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:43:26.472224 3934 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:43:26.569736 3943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:26.570050 3943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:26.570125 3943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:26.574579 3943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:26.574659 3943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:26.574744 3943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:26.580031 3943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:44125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=34339
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:26.581054 3943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:26.582063 3943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:26.592368 3948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.592432 3943 server_base.cc:1034] running on GCE node
W20260809 15:43:26.592375 3949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.592726 3954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.593160 3943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:26.593765 3943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:26.594924 3943 hybrid_clock.cc:648] HybridClock initialized: now 1786290206594908 us; error 27 us; skew 500 ppm
Aug 09 15:43:26 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290206, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:26.597831 3943 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:26.598875 3943 webserver.cc:460] Webserver started at http://127.14.15.130:34339/ using document root <none> and password file <none>
I20260809 15:43:26.599531 3943 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:26.599628 3943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:26.603642 3943 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:43:26.605844 3965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.607193 3943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:43:26.607333 3943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "6416c86950ac4042bcd41c69cbf3735d"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "640dd58ababb45fa73ea58a2eff8fd96"
server_key_iv: "6b2b2a59e92252d8306a053f9d5c856a"
server_key_version: "encryptionkey@0"
I20260809 15:43:26.607915 3943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:26.633848 3943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:26.638022 3943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:26.638324 3943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:26.639148 3943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:26.640228 3943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:26.640302 3943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.640364 3943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:26.640398 3943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.656689 3943 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:44125
I20260809 15:43:26.656706 4125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:44125 every 8 connection(s)
I20260809 15:43:26.658152 3943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:26.663591 4129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.660874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:49287)
0809 15:43:26.661517 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.661706 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":135,"threads_started":1}
W20260809 15:43:26.664273 4126 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:35563 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:35563: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
I20260809 15:43:26.665153 4129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.664827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:55473)
0809 15:43:26.664994 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.665072 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 15:43:26.665987 4129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.665725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:53891)
0809 15:43:26.665854 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.665915 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 15:43:26.666277 4126 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:43:26.667667 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 3943
I20260809 15:43:26.668138 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:38949
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:35563
--webserver_port=39603
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:26.790473 4130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:26.790728 4130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:26.790772 4130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:26.794776 4130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:26.794842 4130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:26.794900 4130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:26.800498 4130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:38949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=39603
--tserver_master_addrs=127.14.15.190:35563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:26.801577 4130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:26.802625 4130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:26.812796 4136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.812795 4138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:26.812800 4140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:26.813242 4130 server_base.cc:1034] running on GCE node
I20260809 15:43:26.813673 4130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:26.814393 4130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:26.815590 4130 hybrid_clock.cc:648] HybridClock initialized: now 1786290206815554 us; error 49 us; skew 500 ppm
Aug 09 15:43:26 dist-test-slave-jztv krb5kdc[2102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290206, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:26.818413 4130 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:26.819245 4130 webserver.cc:460] Webserver started at http://127.14.15.131:39603/ using document root <none> and password file <none>
I20260809 15:43:26.819782 4130 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:26.819844 4130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:26.823640 4130 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:26.825845 4161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.827344 4130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:26.827512 4130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "1de47f6015d3457dac33491d718d5a6e"
format_stamp: "Formatted at 2026-08-09 15:43:24 on dist-test-slave-jztv"
server_key: "b56df965e5452716f5a5b700b60736f3"
server_key_iv: "fb661088fa5d591732f4b35647f8d3b0"
server_key_version: "encryptionkey@0"
I20260809 15:43:26.828081 4130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:26.842888 4130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:26.846129 4130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:26.846391 4130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:26.847065 4130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:26.847952 4130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:26.848002 4130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.848075 4130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:26.848122 4130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:26.857657 4130 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:38949
I20260809 15:43:26.857748 4322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:38949 every 8 connection(s)
I20260809 15:43:26.858804 4130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:26.862939 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.861094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:57357)
0809 15:43:26.861599 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.861721 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
W20260809 15:43:26.863497 4323 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:35563 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:35563: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
I20260809 15:43:26.864183 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.863916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:45559)
0809 15:43:26.864065 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.864116 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 15:43:26.864975 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:26.864766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:37127)
0809 15:43:26.864865 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:26.864910 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:43:26.865219 4323 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:43:26.868148 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 4130
I20260809 15:43:27.473351 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:27.472924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:57737)
0809 15:43:27.473174 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:27.473229 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
I20260809 15:43:27.667323 4330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:27.666893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:36365)
0809 15:43:27.667151 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:27.667211 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260809 15:43:27.866303 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:27.865785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:45185)
0809 15:43:27.866074 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:27.866135 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":72,"threads_started":1}
I20260809 15:43:28.474596 4334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:28.474124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:56691)
0809 15:43:28.474419 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:28.474475 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":136,"threads_started":1}
I20260809 15:43:28.668808 4335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:28.668314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:42063)
0809 15:43:28.668601 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:28.668662 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":100,"threads_started":1}
I20260809 15:43:28.867511 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:28.867042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:54845)
0809 15:43:28.867303 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:28.867377 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":76,"threads_started":1}
I20260809 15:43:29.475937 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:29.475444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:42525)
0809 15:43:29.475766 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:29.475828 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260809 15:43:29.670325 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:29.669746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:42573)
0809 15:43:29.670079 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:29.670156 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":84,"threads_started":1}
I20260809 15:43:29.868969 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:29.868442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:45883)
0809 15:43:29.868787 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:29.868855 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":81,"threads_started":1}
I20260809 15:43:30.477360 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:30.476876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:47451)
0809 15:43:30.477182 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:30.477243 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":100,"threads_started":1}
I20260809 15:43:30.671736 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:30.671226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:34533)
0809 15:43:30.671567 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:30.671631 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":104,"threads_started":1}
I20260809 15:43:30.870316 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:30.869785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:37329)
0809 15:43:30.870062 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:30.870138 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":80,"threads_started":1}
I20260809 15:43:31.478901 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:31.478397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:39589)
0809 15:43:31.478735 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:31.478799 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":95,"threads_started":1}
I20260809 15:43:31.673048 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:31.672591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:48527)
0809 15:43:31.672881 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:31.672938 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":124,"threads_started":1}
I20260809 15:43:31.871620 4348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:31.871168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:37857)
0809 15:43:31.871456 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:31.871515 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":82,"threads_started":1}
I20260809 15:43:32.480317 4349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:32.479853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:51501)
0809 15:43:32.480150 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:32.480214 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":83,"threads_started":1}
I20260809 15:43:32.674491 4350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:32.673941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:60059)
0809 15:43:32.674272 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:32.674368 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
I20260809 15:43:32.873024 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:32.872500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:60209)
0809 15:43:32.872849 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:32.872913 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":112,"threads_started":1}
I20260809 15:43:33.481657 4353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:33.481130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:37063)
0809 15:43:33.481481 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:33.481553 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":81,"threads_started":1}
I20260809 15:43:33.675951 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:33.675391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:38377)
0809 15:43:33.675768 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:33.675833 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":100,"threads_started":1}
I20260809 15:43:33.874655 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:33.873937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:53405)
0809 15:43:33.874464 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:33.874533 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":84,"threads_started":1}
I20260809 15:43:34.483139 4357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:34.482675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:51443)
0809 15:43:34.482960 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:34.483022 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":81,"threads_started":1}
I20260809 15:43:34.677225 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:34.676805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:48177)
0809 15:43:34.677063 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:34.677125 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260809 15:43:34.876207 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:34.875593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:37045)
0809 15:43:34.876029 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:34.876108 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":120,"threads_started":1}
I20260809 15:43:35.484448 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:35.483981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:51107)
0809 15:43:35.484261 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:35.484318 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":87,"threads_started":1}
I20260809 15:43:35.678598 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:35.678059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:39373)
0809 15:43:35.678425 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:35.678493 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":90,"threads_started":1}
I20260809 15:43:35.877800 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:35.877161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:38575)
0809 15:43:35.877554 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:35.877676 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":124,"threads_started":1}
I20260809 15:43:36.485769 4365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:36.485286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:44857)
0809 15:43:36.485612 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:36.485670 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
I20260809 15:43:36.680068 4367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:36.679509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:57833)
0809 15:43:36.679851 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:36.679927 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
I20260809 15:43:36.879165 4368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:36.878674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:34575)
0809 15:43:36.878991 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:36.879064 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
I20260809 15:43:37.487057 4370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:37.486606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:38067)
0809 15:43:37.486893 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:37.486955 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
I20260809 15:43:37.681418 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:37.680965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:37817)
0809 15:43:37.681254 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:37.681317 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":97,"threads_started":1}
I20260809 15:43:37.880605 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:37.880144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:56225)
0809 15:43:37.880444 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:37.880500 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":114,"threads_started":1}
I20260809 15:43:38.488372 4373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:38.487909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:58579)
0809 15:43:38.488184 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:38.488245 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
I20260809 15:43:38.682977 4375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:38.682479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:53993)
0809 15:43:38.682800 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:38.682868 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":87,"threads_started":1}
I20260809 15:43:38.881829 4376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:38.881427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:50503)
0809 15:43:38.881679 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:38.881733 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":81,"threads_started":1}
I20260809 15:43:39.489701 4377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:39.489291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:35985)
0809 15:43:39.489541 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:39.489599 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260809 15:43:39.684366 4378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:39.683885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:34989)
0809 15:43:39.684201 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:39.684262 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":96,"threads_started":1}
I20260809 15:43:39.883114 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:39.882653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:48239)
0809 15:43:39.882953 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:39.883013 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":96,"threads_started":1}
I20260809 15:43:40.491065 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:40.490603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:44157)
0809 15:43:40.490897 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:40.490965 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":95,"threads_started":1}
I20260809 15:43:40.685643 4382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:40.685205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:37639)
0809 15:43:40.685477 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:40.685542 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":94,"threads_started":1}
I20260809 15:43:40.884372 4384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:40.883901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:36181)
0809 15:43:40.884211 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:40.884271 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":95,"threads_started":1}
I20260809 15:43:41.492538 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:41.492083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.129:53839)
0809 15:43:41.492358 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:41.492421 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":80,"threads_started":1}
I20260809 15:43:41.687211 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:41.686766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.130:57223)
0809 15:43:41.687047 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:41.687105 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":102,"threads_started":1}
I20260809 15:43:41.879400 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 3718
I20260809 15:43:41.888478 4389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:41.885959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:35563 (local address 127.14.15.131:58747)
0809 15:43:41.888262 (+ 2303us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:41.888340 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:35563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2197,"thread_start_us":71,"threads_started":1}
I20260809 15:43:41.904016 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 3943
I20260809 15:43:41.919479 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 4130
2026-08-09T15:43:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19738 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:43:41 dist-test-slave-jztv krb5kdc[4395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:43:41 dist-test-slave-jztv krb5kdc[4395](info): set up 2 sockets
Aug 09 15:43:41 dist-test-slave-jztv krb5kdc[4395](info): commencing operation
krb5kdc: starting...
W20260809 15:43:43.161769 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:43:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:43:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:43:43.302273 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:46373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:43.422624 4414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:43.422933 4414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:43.423012 4414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:43.427039 4414 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:43:43.427124 4414 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:43:43.427155 4414 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:43:43.427191 4414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:43:43.427237 4414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:43.427301 4414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:43.427341 4414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:43:43.427376 4414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:43:43.432762 4414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:46373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:43.433866 4414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:43.434902 4414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:43:43.444306 4414 server_base.cc:1034] running on GCE node
W20260809 15:43:43.444245 4422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.444245 4419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.444224 4420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:43.445114 4414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:43.446201 4414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:43.447453 4414 hybrid_clock.cc:648] HybridClock initialized: now 1786290223447440 us; error 36 us; skew 500 ppm
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:43.450174 4414 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:43:43.451157 4414 webserver.cc:460] Webserver started at http://127.14.15.190:37855/ using document root <none> and password file <none>
I20260809 15:43:43.451725 4414 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:43.451818 4414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:43.452064 4414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:43.454078 4414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "911b3800c7d94787af0f3a94ae2fc781"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "849e736a1dd0f962b58a5ee03cf01685"
server_key_iv: "05772d7b7944369d75ce5340a736ba0f"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.454735 4414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "911b3800c7d94787af0f3a94ae2fc781"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "849e736a1dd0f962b58a5ee03cf01685"
server_key_iv: "05772d7b7944369d75ce5340a736ba0f"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.458463 4414 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:43.460847 4432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.462117 4414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:43:43.462338 4414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "911b3800c7d94787af0f3a94ae2fc781"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "849e736a1dd0f962b58a5ee03cf01685"
server_key_iv: "05772d7b7944369d75ce5340a736ba0f"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.462473 4414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:43.472082 4414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:43.476080 4414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:43.476284 4414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:43.483601 4414 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:46373
I20260809 15:43:43.483919 4509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:46373 every 8 connection(s)
I20260809 15:43:43.484596 4414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:43:43.487450 4510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:43.490144 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 4414
I20260809 15:43:43.490310 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:43:43.490680 14398 external_mini_cluster.cc:1428] Setting key aeb4594037fad3489fa074ca16da3caf
I20260809 15:43:43.493635 4510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap starting.
I20260809 15:43:43.496245 4510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:43.497164 4510 log.cc:824] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:43.499135 4510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: No bootstrap required, opened a new log
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:43.503118 4510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:43:43.503394 4510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:43.503499 4510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Initialized, Role: FOLLOWER
I20260809 15:43:43.503975 4510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:43:43.504135 4510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:43:43.504273 4510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:43:43.504387 4510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:43.505616 4510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:43:43.505715 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:43.492088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46570 (local address 127.14.15.190:46373)
0809 15:43:43.492524 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:43.492547 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:43.492581 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:43:43.493229 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:43.493246 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:43.493590 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:43.493915 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:43.494825 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.495856 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.497049 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.497558 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.497735 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:43.500285 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:43.500290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:43.500303 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:43.500330 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:43.502326 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:43.502813 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:43.502821 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:43.502832 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:43.502951 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:43.503250 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:43.503254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:43.503256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:43.503824 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:43.504072 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:43.504360 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 15:43:43.504712 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":124,"threads_started":1}
I20260809 15:43:43.506009 4510 leader_election.cc:302] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911b3800c7d94787af0f3a94ae2fc781; no voters:
I20260809 15:43:43.506379 4510 leader_election.cc:288] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:43:43.506507 4517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:43.507589 4510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:43:43.506778 4517 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 LEADER]: Becoming Leader. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Running, Role: LEADER
I20260809 15:43:43.508080 4517 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:43:43.509372 4517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911b3800c7d94787af0f3a94ae2fc781. Latest consensus state: current_term: 1 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:43:43.509517 4517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:43.509824 4519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:43:43.510128 4519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:43:43.510468 4536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:43:43.513655 4536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:43:43.519292 4536 catalog_manager.cc:1347] Generated new cluster ID: 28148401a52d4520a9d79e3fe879e6fa
I20260809 15:43:43.519377 4536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:43:43.535068 4536 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:43:43.536372 4536 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:43:43.541699 4536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Generated new TSK 0
I20260809 15:43:43.542521 4536 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:43:43.573516 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:43.692015 4545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:43.692273 4545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:43.692317 4545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:43.696435 4545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:43.696497 4545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:43.696591 4545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:43:43.701865 4545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:43.702909 4545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:43.703936 4545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:43.714063 4558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.714037 4553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.714037 4554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:43.714178 4545 server_base.cc:1034] running on GCE node
I20260809 15:43:43.714886 4545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:43.715569 4545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:43.716765 4545 hybrid_clock.cc:648] HybridClock initialized: now 1786290223716741 us; error 36 us; skew 500 ppm
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:43.719688 4545 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:43:43.720662 4545 webserver.cc:460] Webserver started at http://127.14.15.129:36225/ using document root <none> and password file <none>
I20260809 15:43:43.721290 4545 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:43.721390 4545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:43.721645 4545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:43.723953 4545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "be13cf18958a44c3b70ceef231be8e0f"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "58d0cac70f05cc7e45966c1a3b7538cf"
server_key_iv: "e809c88de39554c491d5e39811dd4aeb"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.724592 4545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "be13cf18958a44c3b70ceef231be8e0f"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "58d0cac70f05cc7e45966c1a3b7538cf"
server_key_iv: "e809c88de39554c491d5e39811dd4aeb"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.728829 4545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 15:43:43.731554 4570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.732892 4545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:43:43.733060 4545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "be13cf18958a44c3b70ceef231be8e0f"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "58d0cac70f05cc7e45966c1a3b7538cf"
server_key_iv: "e809c88de39554c491d5e39811dd4aeb"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.733194 4545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:43.748029 4545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:43.751282 4545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:43.751502 4545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:43.752120 4545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:43.752975 4545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:43.753048 4545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.753127 4545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:43.753181 4545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.763047 4545 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:37289
I20260809 15:43:43.763077 4732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:37289 every 8 connection(s)
I20260809 15:43:43.763975 4545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:43:43.771314 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 4545
I20260809 15:43:43.771474 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:43:43.771806 14398 external_mini_cluster.cc:1428] Setting key 72fae0ed252fe6546fbc4630115f12e5
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:43.779111 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:43.765870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:41009 (local address 127.14.15.190:46373)
0809 15:43:43.766043 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:43.766047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:43.767004 (+ 957us) server_negotiation.cc:407] Connection header received
0809 15:43:43.768444 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:43.768448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:43.768513 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:43.768614 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:43.769814 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.770439 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.771973 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.772266 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.772398 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:43.775323 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:43.775326 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:43.775328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:43.775355 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:43.776862 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:43.777413 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:43.777417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:43.777419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:43.777507 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:43.777870 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:43.777875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:43.777876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:43.778084 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:43.778208 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:43.778782 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 15:43:43.778918 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 15:43:43.779953 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:43.766341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:41009)
0809 15:43:43.766845 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:43.766895 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:43.768202 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:43.768797 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:43.768803 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:43.769175 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:43.769658 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:43.769671 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.770571 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.770579 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:43.771820 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:43.771837 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.772470 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.772475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:43.772675 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:43.773352 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:43.773375 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:43.775137 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:43.777002 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:43.777008 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:43.777024 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:43.777302 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:43.777612 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:43.777616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:43.777618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:43.777770 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:43.778207 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:43.778252 (+ 45us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:43.778516 (+ 264us) client_negotiation.cc:769] Sending connection context
0809 15:43:43.778727 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 15:43:43.779074 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":105,"threads_started":1}
I20260809 15:43:43.781443 4733 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:43:43.781706 4733 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:43.782299 4733 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:43:43.783937 4447 ts_manager.cc:194] Registered new tserver with Master: be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289)
I20260809 15:43:43.785094 4447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:41009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:43:43.801523 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:43.918872 4741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:43.919109 4741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:43.919152 4741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:43.923112 4741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:43.923164 4741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:43.923221 4741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:43:43.928305 4741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:43.929268 4741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:43.930271 4741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:43.940253 4749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.940260 4746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:43.940265 4747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:43.940651 4741 server_base.cc:1034] running on GCE node
I20260809 15:43:43.941095 4741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:43.941744 4741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:43.942922 4741 hybrid_clock.cc:648] HybridClock initialized: now 1786290223942885 us; error 48 us; skew 500 ppm
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:43.945976 4741 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:43:43.946982 4741 webserver.cc:460] Webserver started at http://127.14.15.130:35523/ using document root <none> and password file <none>
I20260809 15:43:43.947582 4741 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:43.947678 4741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:43.947924 4741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:43.950037 4741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "9637c938ed24415f97b7c565be6fd8a0"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "afdb3afd3f76cc94192b68daf23d4665"
server_key_iv: "63610089950492ea58f42d7a140de142"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.950672 4741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "9637c938ed24415f97b7c565be6fd8a0"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "afdb3afd3f76cc94192b68daf23d4665"
server_key_iv: "63610089950492ea58f42d7a140de142"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.954427 4741 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:43:43.956768 4757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.957974 4741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:43:43.958112 4741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "9637c938ed24415f97b7c565be6fd8a0"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "afdb3afd3f76cc94192b68daf23d4665"
server_key_iv: "63610089950492ea58f42d7a140de142"
server_key_version: "encryptionkey@0"
I20260809 15:43:43.958261 4741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:43.972064 4741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:43.975157 4741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:43.975392 4741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:43.976053 4741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:43.976899 4741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:43.976976 4741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.977046 4741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:43.977088 4741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:43.985890 4741 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:35487
I20260809 15:43:43.985931 4934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:35487 every 8 connection(s)
I20260809 15:43:43.986796 4741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:43:43.989135 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 4741
I20260809 15:43:43.989290 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:43:43.989650 14398 external_mini_cluster.cc:1428] Setting key 85f110d7155ce6be330142f0d8176c4f
Aug 09 15:43:43 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290223, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:43:44.002319 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:43.988601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:50999 (local address 127.14.15.190:46373)
0809 15:43:43.988741 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:43.988745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:43.989666 (+ 921us) server_negotiation.cc:407] Connection header received
0809 15:43:43.991337 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:43.991340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:43.991383 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:43.991453 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:43.993096 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.993660 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.995457 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.995671 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.995756 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:43.998746 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:43.998749 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:43.998751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:43.998776 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:44.000214 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.000755 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.000759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.000760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.000835 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.001195 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.001198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.001200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.001389 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:44.001512 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.002006 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.002129 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:43:44.003134 4939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:43.988968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:50999)
0809 15:43:43.989476 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:43.989549 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:43.991111 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:43.991666 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:43.991679 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:43.992217 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:43.992940 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:43.992963 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.993798 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.993804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:43.995331 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:43.995347 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:43.995831 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:43.995839 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:43.996090 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:43.996748 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:43.996774 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:43.998566 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:44.000339 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:44.000345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:44.000361 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:44.000635 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:44.000935 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:44.000938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:44.000940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:44.001087 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:44.001503 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:44.001509 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:44.001757 (+ 248us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.001945 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.002351 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:43:44.004477 4937 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:43:44.004745 4937 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:44.005262 4937 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
I20260809 15:43:44.006444 4447 ts_manager.cc:194] Registered new tserver with Master: 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
I20260809 15:43:44.007086 4447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:50999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:43:44.020744 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:43:44.135216 4942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:43:44.135535 4942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:43:44.135634 4942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:43:44.140058 4942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:43:44.140143 4942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:43:44.140235 4942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:43:44.145431 4942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:43:44.146549 4942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:43:44.147567 4942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:43:44.157204 4951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:43:44.157205 4948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:44.157274 4942 server_base.cc:1034] running on GCE node
W20260809 15:43:44.157354 4949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:43:44.157891 4942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:43:44.158604 4942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:43:44.159773 4942 hybrid_clock.cc:648] HybridClock initialized: now 1786290224159758 us; error 25 us; skew 500 ppm
Aug 09 15:43:44 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290224, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:43:44.162739 4942 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:43:44.163648 4942 webserver.cc:460] Webserver started at http://127.14.15.131:43613/ using document root <none> and password file <none>
I20260809 15:43:44.164216 4942 fs_manager.cc:359] Metadata directory not provided
I20260809 15:43:44.164309 4942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:43:44.164543 4942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:43:44.166749 4942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "88f0e86858894686af800ed5156569db"
format_stamp: "Formatted at 2026-08-09 15:43:44 on dist-test-slave-jztv"
server_key: "155e24769a0338c581ec45caf28bda2b"
server_key_iv: "f97e609b285f620d3af4fc953f8d91f4"
server_key_version: "encryptionkey@0"
I20260809 15:43:44.167375 4942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "88f0e86858894686af800ed5156569db"
format_stamp: "Formatted at 2026-08-09 15:43:44 on dist-test-slave-jztv"
server_key: "155e24769a0338c581ec45caf28bda2b"
server_key_iv: "f97e609b285f620d3af4fc953f8d91f4"
server_key_version: "encryptionkey@0"
I20260809 15:43:44.171113 4942 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:43:44.173516 4959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:44.174799 4942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:43:44.174949 4942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "88f0e86858894686af800ed5156569db"
format_stamp: "Formatted at 2026-08-09 15:43:44 on dist-test-slave-jztv"
server_key: "155e24769a0338c581ec45caf28bda2b"
server_key_iv: "f97e609b285f620d3af4fc953f8d91f4"
server_key_version: "encryptionkey@0"
I20260809 15:43:44.175072 4942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:43:44.192225 4942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:43:44.195621 4942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:43:44.195834 4942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:43:44.196441 4942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:43:44.197332 4942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:43:44.197405 4942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:44.197479 4942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:43:44.197530 4942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:43:44.206775 4942 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:39585
I20260809 15:43:44.206794 5143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:39585 every 8 connection(s)
I20260809 15:43:44.207763 4942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:43:44.208127 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 4942
I20260809 15:43:44.208285 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:43:44.208710 14398 external_mini_cluster.cc:1428] Setting key 3f740e5cb02912efabc66fe0d8a1f001
Aug 09 15:43:44 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290224, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:43:44.221341 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.209744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:47537 (local address 127.14.15.190:46373)
0809 15:43:44.209892 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.209896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.210996 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 15:43:44.212332 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.212335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.212379 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.212447 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:44.213595 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.214123 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.215399 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.215617 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.215701 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.218051 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:44.218054 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:44.218056 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:44.218080 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:44.219435 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.219908 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.219910 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.219912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.219986 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.220305 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.220307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.220309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.220490 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:44.220569 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.221081 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.221212 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:43:44.222450 5146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.210296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:47537)
0809 15:43:44.210831 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.210891 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.212147 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.212627 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.212633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.212987 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:43:44.213455 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.213468 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.214291 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.214294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.215286 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.215297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.215750 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.215753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.215893 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.216421 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:43:44.216438 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:43:44.217888 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:43:44.219548 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:44.219553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:44.219565 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:44.219822 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:44.220075 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:43:44.220077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:43:44.220078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:43:44.220216 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:43:44.220594 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:43:44.220600 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:43:44.220838 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.221003 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.221329 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":133,"threads_started":1}
I20260809 15:43:44.223574 5144 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:43:44.223837 5144 heartbeater.cc:464] Registering TS with master...
I20260809 15:43:44.224346 5144 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
I20260809 15:43:44.225409 4447 ts_manager.cc:194] Registered new tserver with Master: 88f0e86858894686af800ed5156569db (127.14.15.131:39585)
I20260809 15:43:44.225986 4447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:47537
I20260809 15:43:44.234824 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:43:44.244661 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.236817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46578 (local address 127.14.15.190:46373)
0809 15:43:44.236989 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.236993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.237273 (+ 280us) server_negotiation.cc:407] Connection header received
0809 15:43:44.237365 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.237367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.237408 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.237475 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:43:44.238267 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.238894 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.239772 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.240000 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.240113 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.241508 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:43:44.241512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:43:44.241519 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:43:44.241557 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:43:44.242931 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.243374 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.243382 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.243384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.243457 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:43:44.243742 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:43:44.243746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:43:44.243748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:43:44.243971 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:43:44.244119 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.244368 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.244485 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:43:44.247581 4447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:43:44.250701 4447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:43:44.266043 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.260218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56952 (local address 127.14.15.130:35487)
0809 15:43:44.260642 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.260653 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.260676 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:43:44.260756 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.260761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.260961 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.261443 (+ 482us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:44.261645 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.262661 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.264508 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.265350 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.265467 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.265637 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.265779 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.265872 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":101,"threads_started":1}
I20260809 15:43:44.266042 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.259590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:35487 (local address 127.0.0.1:56952)
0809 15:43:44.260313 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.260330 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.260423 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.261118 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.261121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.261133 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:44.261280 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.261288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.262783 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.262789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.264355 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.264367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.265479 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.265483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.265602 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.265641 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.265750 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.265872 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":109,"thread_start_us":109,"threads_started":1}
I20260809 15:43:44.266379 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.260096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:39585 (local address 127.0.0.1:38996)
0809 15:43:44.260816 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.260828 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.260905 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.261940 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.261943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.261963 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:44.262047 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.262053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.263434 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.263437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.264571 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.264582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.265885 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.265889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.265992 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.266019 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.266107 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.266189 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":44,"thread_start_us":114,"threads_started":1}
I20260809 15:43:44.266867 5166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.260695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.14.15.131:39585)
0809 15:43:44.261470 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.261483 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.261507 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:43:44.261585 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.261589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.261781 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.261943 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:44.262147 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.263283 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.264706 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.265569 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.265679 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.265817 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.266611 (+ 794us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.266721 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":105,"threads_started":1}
I20260809 15:43:44.267455 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.259595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55710 (local address 127.14.15.129:37289)
0809 15:43:44.259888 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.259909 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.260492 (+ 583us) server_negotiation.cc:407] Connection header received
0809 15:43:44.260588 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.260593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.260820 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.261003 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:44.261396 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.262801 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.265239 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.266341 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.266459 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.266667 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.267106 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.267267 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":93,"threads_started":1}
I20260809 15:43:44.267956 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.259406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37289 (local address 127.0.0.1:55710)
0809 15:43:44.260104 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.260160 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.260330 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.261035 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.261044 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.261074 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:44.261280 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.261288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.262953 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.262956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.265107 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.265119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.266744 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.266749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.266863 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.266936 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.267719 (+ 783us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.267818 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":946,"thread_start_us":78,"threads_started":1}
I20260809 15:43:44.269747 5034 tablet_service.cc:1467] Processing CreateTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 (DEFAULT_TABLE table=test-table [id=c051b748d06549ce9a8d75afd617eb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:44.269688 4831 tablet_service.cc:1467] Processing CreateTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 (DEFAULT_TABLE table=test-table [id=c051b748d06549ce9a8d75afd617eb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:44.270918 4831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc1a55459f9d4418b4e790d4b9e32ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:44.270941 5034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc1a55459f9d4418b4e790d4b9e32ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:44.270768 4635 tablet_service.cc:1467] Processing CreateTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 (DEFAULT_TABLE table=test-table [id=c051b748d06549ce9a8d75afd617eb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:43:44.271739 4635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc1a55459f9d4418b4e790d4b9e32ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:43:44.277746 5168 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Bootstrap starting.
I20260809 15:43:44.279093 5170 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Bootstrap starting.
I20260809 15:43:44.279706 5172 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Bootstrap starting.
I20260809 15:43:44.281751 5170 tablet_bootstrap.cc:654] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:44.282531 5172 tablet_bootstrap.cc:654] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:44.282646 5170 log.cc:824] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:44.283571 5172 log.cc:824] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:44.284880 5170 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: No bootstrap required, opened a new log
I20260809 15:43:44.285148 5170 ts_tablet_manager.cc:1397] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:43:44.286643 5168 tablet_bootstrap.cc:654] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Neither blocks nor log segments found. Creating new log.
I20260809 15:43:44.287348 5172 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: No bootstrap required, opened a new log
I20260809 15:43:44.287614 5172 ts_tablet_manager.cc:1397] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 15:43:44.289140 5168 log.cc:824] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Log is configured to *not* fsync() on all Append() calls
I20260809 15:43:44.289769 5170 raft_consensus.cc:348] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.290130 5170 raft_consensus.cc:374] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:44.290261 5170 raft_consensus.cc:729] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9637c938ed24415f97b7c565be6fd8a0, State: Initialized, Role: FOLLOWER
I20260809 15:43:44.290778 5170 consensus_queue.cc:260] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.291520 4937 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
I20260809 15:43:44.291908 5170 ts_tablet_manager.cc:1428] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:43:44.292035 5168 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: No bootstrap required, opened a new log
I20260809 15:43:44.292243 5168 ts_tablet_manager.cc:1397] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260809 15:43:44.293740 5172 raft_consensus.cc:348] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.294045 5172 raft_consensus.cc:374] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:44.294168 5172 raft_consensus.cc:729] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be13cf18958a44c3b70ceef231be8e0f, State: Initialized, Role: FOLLOWER
I20260809 15:43:44.294744 5172 consensus_queue.cc:260] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.295483 4733 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
I20260809 15:43:44.296599 5168 raft_consensus.cc:348] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.296895 5168 raft_consensus.cc:374] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:43:44.297010 5168 raft_consensus.cc:729] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f0e86858894686af800ed5156569db, State: Initialized, Role: FOLLOWER
I20260809 15:43:44.297163 5172 ts_tablet_manager.cc:1428] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260809 15:43:44.297564 5168 consensus_queue.cc:260] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.298338 5144 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
I20260809 15:43:44.298683 5168 ts_tablet_manager.cc:1428] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260809 15:43:44.333076 5179 raft_consensus.cc:482] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:43:44.333338 5179 raft_consensus.cc:504] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.334587 5179 leader_election.cc:288] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487), 88f0e86858894686af800ed5156569db (127.14.15.131:39585)
I20260809 15:43:44.339344 5181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.334925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:35487 (local address 127.14.15.129:60711)
0809 15:43:44.335321 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.335340 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.335466 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.335741 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.335746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.335769 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:44.335980 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.335986 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.337118 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.337122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.338130 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.338161 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.338906 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.338997 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.339025 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.339099 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.339152 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"spinlock_wait_cycles":64768,"thread_start_us":153,"threads_started":1}
I20260809 15:43:44.339339 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.335073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:60711 (local address 127.14.15.130:35487)
0809 15:43:44.335267 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.335274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.335458 (+ 184us) server_negotiation.cc:407] Connection header received
0809 15:43:44.335576 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.335579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.335635 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.335727 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:44.336094 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.336968 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338328 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.338762 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338884 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.338953 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.339130 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.339216 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:43:44.339438 5166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.335634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:36277 (local address 127.14.15.131:39585)
0809 15:43:44.335765 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.335769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.335814 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:43:44.335980 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.335983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.336033 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.336118 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:43:44.336516 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.337233 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338388 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.338783 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338936 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.338993 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.339223 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.339296 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:43:44.339399 5182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.335426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:39585 (local address 127.14.15.129:36277)
0809 15:43:44.335741 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.335754 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:43:44.335864 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:43:44.336164 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:43:44.336166 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:43:44.336218 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:43:44.336382 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.336389 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.337399 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.337402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.338205 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:43:44.338266 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.338944 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.338948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:43:44.339061 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.339107 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 15:43:44.339188 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:43:44.339250 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":129,"threads_started":1}
I20260809 15:43:44.340330 4862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc1a55459f9d4418b4e790d4b9e32ca6" candidate_uuid: "be13cf18958a44c3b70ceef231be8e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9637c938ed24415f97b7c565be6fd8a0" is_pre_election: true
I20260809 15:43:44.340462 5066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc1a55459f9d4418b4e790d4b9e32ca6" candidate_uuid: "be13cf18958a44c3b70ceef231be8e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f0e86858894686af800ed5156569db" is_pre_election: true
I20260809 15:43:44.340698 4862 raft_consensus.cc:2454] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be13cf18958a44c3b70ceef231be8e0f in term 0.
I20260809 15:43:44.340767 5066 raft_consensus.cc:2454] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be13cf18958a44c3b70ceef231be8e0f in term 0.
I20260809 15:43:44.341252 4575 leader_election.cc:302] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9637c938ed24415f97b7c565be6fd8a0, be13cf18958a44c3b70ceef231be8e0f; no voters:
I20260809 15:43:44.341501 5179 raft_consensus.cc:2781] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:43:44.341607 5179 raft_consensus.cc:482] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:43:44.341671 5179 raft_consensus.cc:3037] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:44.342767 5179 raft_consensus.cc:504] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.343124 5179 leader_election.cc:288] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 1 election: Requested vote from peers 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487), 88f0e86858894686af800ed5156569db (127.14.15.131:39585)
I20260809 15:43:44.343492 4862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc1a55459f9d4418b4e790d4b9e32ca6" candidate_uuid: "be13cf18958a44c3b70ceef231be8e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9637c938ed24415f97b7c565be6fd8a0"
I20260809 15:43:44.343627 4862 raft_consensus.cc:3037] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:44.343644 5066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc1a55459f9d4418b4e790d4b9e32ca6" candidate_uuid: "be13cf18958a44c3b70ceef231be8e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f0e86858894686af800ed5156569db"
I20260809 15:43:44.343783 5066 raft_consensus.cc:3037] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:43:44.344717 4862 raft_consensus.cc:2454] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be13cf18958a44c3b70ceef231be8e0f in term 1.
I20260809 15:43:44.344877 5066 raft_consensus.cc:2454] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be13cf18958a44c3b70ceef231be8e0f in term 1.
I20260809 15:43:44.345119 4575 leader_election.cc:302] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9637c938ed24415f97b7c565be6fd8a0, be13cf18958a44c3b70ceef231be8e0f; no voters:
I20260809 15:43:44.345315 5179 raft_consensus.cc:2781] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:43:44.345579 5179 raft_consensus.cc:686] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 LEADER]: Becoming Leader. State: Replica: be13cf18958a44c3b70ceef231be8e0f, State: Running, Role: LEADER
I20260809 15:43:44.345929 5179 consensus_queue.cc:237] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:43:44.349262 4447 catalog_manager.cc:5495] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f reported cstate change: term changed from 0 to 1, leader changed from <none> to be13cf18958a44c3b70ceef231be8e0f (127.14.15.129). New cstate: current_term: 1 leader_uuid: "be13cf18958a44c3b70ceef231be8e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260809 15:43:44.368022 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.364446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55720 (local address 127.14.15.129:37289)
0809 15:43:44.364595 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:43:44.364599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:43:44.364612 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:43:44.364687 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:43:44.364689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:43:44.364740 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:43:44.364825 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:43:44.365040 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.365526 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.366540 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:43:44.366757 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:43:44.366874 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:43:44.367205 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:43:44.367626 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:43:44.367769 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 15:43:44.367812 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 15:43:44.367871 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:43:44.374060 5066 raft_consensus.cc:1261] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Refusing update from remote peer be13cf18958a44c3b70ceef231be8e0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:44.374060 4862 raft_consensus.cc:1261] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Refusing update from remote peer be13cf18958a44c3b70ceef231be8e0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:43:44.374895 5179 consensus_queue.cc:1035] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:44.375131 5183 consensus_queue.cc:1035] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:43:44.384093 5192 mvcc.cc:205] Tried to move back new op lower bound from 7316644759028432896 to 7316644758923923456. Current Snapshot: MvccSnapshot[applied={T|T < 7316644759028432896}]
I20260809 15:43:44.384161 5191 mvcc.cc:205] Tried to move back new op lower bound from 7316644759028432896 to 7316644758923923456. Current Snapshot: MvccSnapshot[applied={T|T < 7316644759028432896}]
I20260809 15:43:44.394326 4450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:44.394531 4450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:43:44.396972 4450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Sending DeleteTablet for 3 replicas of tablet cc1a55459f9d4418b4e790d4b9e32ca6
I20260809 15:43:44.397802 4635 tablet_service.cc:1514] Processing DeleteTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:44 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:55710
I20260809 15:43:44.397848 4831 tablet_service.cc:1514] Processing DeleteTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:44 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:56952
I20260809 15:43:44.398092 5034 tablet_service.cc:1514] Processing DeleteTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:44 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:38996
I20260809 15:43:44.398409 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 4545
I20260809 15:43:44.404433 5204 tablet_replica.cc:330] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: stopping tablet replica
I20260809 15:43:44.404834 5204 raft_consensus.cc:2229] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:44.405158 5204 raft_consensus.cc:2258] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:44.407220 5206 tablet_replica.cc:330] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: stopping tablet replica
I20260809 15:43:44.407541 5206 raft_consensus.cc:2229] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:43:44.407819 5206 raft_consensus.cc:2258] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:43:44.409581 5204 ts_tablet_manager.cc:1905] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:44.409724 5206 ts_tablet_manager.cc:1905] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:43:44.412025 5206 ts_tablet_manager.cc:1918] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:44.412154 5206 log.cc:1196] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/cc1a55459f9d4418b4e790d4b9e32ca6
I20260809 15:43:44.412461 5206 ts_tablet_manager.cc:1939] T cc1a55459f9d4418b4e790d4b9e32ca6 P 88f0e86858894686af800ed5156569db: Deleting consensus metadata
I20260809 15:43:44.413192 5204 ts_tablet_manager.cc:1918] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:43:44.413300 5204 log.cc:1196] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/cc1a55459f9d4418b4e790d4b9e32ca6
I20260809 15:43:44.413635 5204 ts_tablet_manager.cc:1939] T cc1a55459f9d4418b4e790d4b9e32ca6 P 9637c938ed24415f97b7c565be6fd8a0: Deleting consensus metadata
I20260809 15:43:44.413758 4435 catalog_manager.cc:4841] TS 88f0e86858894686af800ed5156569db (127.14.15.131:39585): tablet cc1a55459f9d4418b4e790d4b9e32ca6 (table test-table [id=c051b748d06549ce9a8d75afd617eb7e]) successfully deleted
I20260809 15:43:44.414985 4435 catalog_manager.cc:4841] TS 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): tablet cc1a55459f9d4418b4e790d4b9e32ca6 (table test-table [id=c051b748d06549ce9a8d75afd617eb7e]) successfully deleted
W20260809 15:43:44.415944 4433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:37289 (error 108)
I20260809 15:43:44.416225 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 4741
I20260809 15:43:44.421711 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:43:44.421175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37289 (local address 127.0.0.1:55724)
0809 15:43:44.421456 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:43:44.421581 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260809 15:43:44.422658 4433 catalog_manager.cc:4584] TS be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc1a55459f9d4418b4e790d4b9e32ca6: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37289: connect: Connection refused (error 111)
I20260809 15:43:44.431175 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 4942
I20260809 15:43:44.444427 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 4414
I20260809 15:44:04.461225 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--webserver_interface=127.14.15.190
--webserver_port=37855
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:46373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:04.577525 5211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:04.577806 5211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:04.577847 5211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:04.581954 5211 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:44:04.582020 5211 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:44:04.582036 5211 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:44:04.582051 5211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:04.582070 5211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:04.582132 5211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:04.582161 5211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:04.582194 5211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:04.587719 5211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:46373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=37855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:04.588871 5211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:04.590090 5211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:44:04.604974 5211 server_base.cc:1034] running on GCE node
W20260809 15:44:04.604902 5220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:04.604902 5221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:04.604907 5223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:04.605980 5211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:04.607224 5211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:04.608402 5211 hybrid_clock.cc:648] HybridClock initialized: now 1786290244608382 us; error 31 us; skew 500 ppm
Aug 09 15:44:04 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290244, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:04.617019 5211 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:44:04.618011 5211 webserver.cc:460] Webserver started at http://127.14.15.190:37855/ using document root <none> and password file <none>
I20260809 15:44:04.618672 5211 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:04.618753 5211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:04.622777 5211 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:44:04.624910 5235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:04.626107 5211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:04.626279 5211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "911b3800c7d94787af0f3a94ae2fc781"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "849e736a1dd0f962b58a5ee03cf01685"
server_key_iv: "05772d7b7944369d75ce5340a736ba0f"
server_key_version: "encryptionkey@0"
I20260809 15:44:04.626889 5211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:04.642779 5211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:04.646127 5211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:04.646358 5211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:04.653692 5211 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:46373
I20260809 15:44:04.653985 5326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:46373 every 8 connection(s)
I20260809 15:44:04.654831 5211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:04.659534 5328 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:44:04.659564 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 5211
I20260809 15:44:04.660008 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:37289
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=36225
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:44:04.661357 5328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap starting.
I20260809 15:44:04.684147 5328 log.cc:824] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:04.693200 5328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:44:04.693621 5328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap complete.
I20260809 15:44:04.697979 5328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:04.698472 5328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Initialized, Role: FOLLOWER
I20260809 15:44:04.698987 5328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:04.699106 5328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:04.699201 5328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:04.699316 5328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:44:04.701324 5328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:04.701687 5328 leader_election.cc:302] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911b3800c7d94787af0f3a94ae2fc781; no voters:
I20260809 15:44:04.702050 5328 leader_election.cc:288] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:44:04.702140 5333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:44:04.702412 5333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 LEADER]: Becoming Leader. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Running, Role: LEADER
I20260809 15:44:04.702787 5333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:04.703408 5328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:04.703776 5333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911b3800c7d94787af0f3a94ae2fc781. Latest consensus state: current_term: 2 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:44:04.703984 5333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:04.704181 5334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:44:04.704305 5334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:04.704591 5339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:04.709625 5339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:04.710353 5339 catalog_manager.cc:1259] Loaded cluster ID: 28148401a52d4520a9d79e3fe879e6fa
I20260809 15:44:04.710422 5339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:04.712975 5339 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:04.713729 5339 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Loaded TSK: 0
I20260809 15:44:04.727078 5339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Generated new TSK 1
I20260809 15:44:04.727378 5339 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:44:04.785720 5331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:04.786021 5331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:04.786095 5331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:04.790128 5331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:04.790215 5331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:04.790320 5331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:04.795538 5331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:37289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=36225
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:04.796603 5331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:04.797633 5331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:04.809034 5369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:04.809177 5371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:04.809034 5368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:04.809428 5331 server_base.cc:1034] running on GCE node
I20260809 15:44:04.810003 5331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:04.810933 5331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:04.812147 5331 hybrid_clock.cc:648] HybridClock initialized: now 1786290244812107 us; error 49 us; skew 500 ppm
Aug 09 15:44:04 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290244, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:04.815629 5331 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:44:04.816594 5331 webserver.cc:460] Webserver started at http://127.14.15.129:36225/ using document root <none> and password file <none>
I20260809 15:44:04.817186 5331 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:04.817299 5331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:04.821457 5331 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:04.823962 5387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:04.825320 5331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:44:04.825495 5331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "be13cf18958a44c3b70ceef231be8e0f"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "58d0cac70f05cc7e45966c1a3b7538cf"
server_key_iv: "e809c88de39554c491d5e39811dd4aeb"
server_key_version: "encryptionkey@0"
I20260809 15:44:04.826063 5331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:04.841828 5331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:04.845108 5331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:04.845314 5331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:04.845917 5331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:04.847153 5396 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:44:04.851343 5331 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:44:04.851403 5331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260809 15:44:04.851473 5331 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:44:04.853140 5331 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:44:04.853199 5331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 15:44:04.853475 5396 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Bootstrap starting.
I20260809 15:44:04.864593 5331 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:37289
I20260809 15:44:04.864609 5565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:37289 every 8 connection(s)
I20260809 15:44:04.865872 5331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:04.868618 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 5331
I20260809 15:44:04.869165 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:35487
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=35523
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:44:04.875329 5396 log.cc:824] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:44:04 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290244, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:04.883497 5396 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:44:04.883915 5396 tablet_bootstrap.cc:492] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Bootstrap complete.
I20260809 15:44:04.885363 5396 ts_tablet_manager.cc:1397] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.008s
I20260809 15:44:04.886302 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:04.868074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:52459)
0809 15:44:04.868721 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:04.868780 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:04.870215 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:04.871677 (+ 1462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:04.871685 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:04.872114 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:04.872577 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:04.872591 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.873915 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.873918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:04.874836 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:04.874847 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.875608 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.875613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:04.875807 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:04.877809 (+ 2002us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:04.877832 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:04.879699 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:04.882570 (+ 2871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:04.882576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:04.882588 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:04.882929 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:04.883380 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:04.883392 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:04.883394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:04.883565 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:04.884400 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:04.884409 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:04.884713 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 15:44:04.884908 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 15:44:04.885267 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":164,"threads_started":1}
I20260809 15:44:04.886376 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:04.868000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:52459 (local address 127.14.15.190:46373)
0809 15:44:04.868368 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:04.868389 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:04.868906 (+ 517us) server_negotiation.cc:407] Connection header received
0809 15:44:04.870771 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:04.870791 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:04.871231 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:04.871626 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:04.872755 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.873728 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.874976 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.875442 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.875620 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:04.879931 (+ 4311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:04.879940 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:04.879959 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:04.880003 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:04.882435 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:04.883073 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:04.883083 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:04.883092 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:04.883262 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:04.883719 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:04.883722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:04.883724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:04.884256 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:04.884427 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:04.885091 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 15:44:04.885452 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":115,"threads_started":1}
I20260809 15:44:04.888290 5396 raft_consensus.cc:348] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:44:04.888705 5396 raft_consensus.cc:729] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: be13cf18958a44c3b70ceef231be8e0f, State: Initialized, Role: FOLLOWER
I20260809 15:44:04.889284 5570 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:44:04.889248 5396 consensus_queue.cc:260] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } }
I20260809 15:44:04.889529 5570 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:04.890060 5570 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
I20260809 15:44:04.890208 5396 ts_tablet_manager.cc:1428] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 15:44:04.892572 5268 ts_manager.cc:194] Registered new tserver with Master: be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289)
I20260809 15:44:04.895875 5268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:52459
I20260809 15:44:04.898734 5570 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
Aug 09 15:44:04 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290244, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.129@KRBTEST.COM
I20260809 15:44:04.906162 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:04.895324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37289 (local address 127.0.0.1:57508)
0809 15:44:04.895915 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:04.895959 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:04.896134 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:04.896660 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:04.896667 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:04.897072 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:04.897179 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:04.897186 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.898479 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.898485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:04.899272 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:04.899284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.900075 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.900079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:04.900192 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:04.900759 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:04.900774 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:04.902385 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:04.904353 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:04.904362 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:04.904368 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:04.904627 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:04.904965 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:04.904968 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:04.904970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:04.905059 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:04.905505 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:04.905512 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:04.905643 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 15:44:04.905777 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 15:44:04.905976 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":113,"threads_started":1}
I20260809 15:44:04.906193 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:04.895430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57508 (local address 127.14.15.129:37289)
0809 15:44:04.896118 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:04.896132 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:04.896155 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:44:04.896286 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:04.896293 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:04.896505 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:04.896633 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:04.897301 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.898358 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.899435 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:04.899938 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:04.900056 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:04.902525 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:04.902535 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:04.902545 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:04.902567 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:04.904242 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:04.904740 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:04.904745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:04.904747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:04.904832 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:04.905150 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:04.905153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:04.905155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:04.905390 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:04.905528 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:04.905870 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 15:44:04.906028 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":546,"thread_start_us":106,"threads_started":1}
I20260809 15:44:04.907123 5471 tablet_service.cc:1514] Processing DeleteTablet for tablet cc1a55459f9d4418b4e790d4b9e32ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:43:44 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:57508
I20260809 15:44:04.907987 5580 tablet_replica.cc:330] stopping tablet replica
I20260809 15:44:04.908304 5580 raft_consensus.cc:2229] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:04.908571 5580 raft_consensus.cc:2258] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:04.909668 5580 ts_tablet_manager.cc:1905] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:04.914304 5580 ts_tablet_manager.cc:1918] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:04.914470 5580 log.cc:1196] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal/wals/cc1a55459f9d4418b4e790d4b9e32ca6
I20260809 15:44:04.914779 5580 ts_tablet_manager.cc:1939] T cc1a55459f9d4418b4e790d4b9e32ca6 P be13cf18958a44c3b70ceef231be8e0f: Deleting consensus metadata
I20260809 15:44:04.916873 5236 catalog_manager.cc:4841] TS be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289): tablet cc1a55459f9d4418b4e790d4b9e32ca6 (table test-table [id=c051b748d06549ce9a8d75afd617eb7e]) successfully deleted
W20260809 15:44:04.997198 5574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:04.997455 5574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:04.997546 5574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:05.001726 5574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:05.001783 5574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:05.001870 5574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:05.007508 5574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:35487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=35523
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:05.008522 5574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:05.009523 5574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:05.019043 5587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:05.019048 5588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:05.019060 5591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:05.019541 5574 server_base.cc:1034] running on GCE node
I20260809 15:44:05.019942 5574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:05.020583 5574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:05.021823 5574 hybrid_clock.cc:648] HybridClock initialized: now 1786290245021807 us; error 26 us; skew 500 ppm
Aug 09 15:44:05 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290245, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:05.024690 5574 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:44:05.025647 5574 webserver.cc:460] Webserver started at http://127.14.15.130:35523/ using document root <none> and password file <none>
I20260809 15:44:05.026274 5574 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:05.026394 5574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:05.030527 5574 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:44:05.032760 5600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.033984 5574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:05.034125 5574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "9637c938ed24415f97b7c565be6fd8a0"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "afdb3afd3f76cc94192b68daf23d4665"
server_key_iv: "63610089950492ea58f42d7a140de142"
server_key_version: "encryptionkey@0"
I20260809 15:44:05.034785 5574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:05.047590 5574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:05.050999 5574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:05.051209 5574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:05.051839 5574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:05.052718 5574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:05.052789 5574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.052862 5574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:05.052902 5574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.062565 5574 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:35487
I20260809 15:44:05.062644 5762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:35487 every 8 connection(s)
I20260809 15:44:05.063661 5574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:05.071419 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 5574
I20260809 15:44:05.071964 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:39585
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=43613
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:44:05 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290245, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:05.079092 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.065521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56347 (local address 127.14.15.190:46373)
0809 15:44:05.065701 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.065706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.066612 (+ 906us) server_negotiation.cc:407] Connection header received
0809 15:44:05.067950 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.067953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.068011 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.068091 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:05.069297 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.069897 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.071140 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.071566 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.071681 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.074660 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:05.074671 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:05.074678 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:05.074720 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:05.076765 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.077324 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.077331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.077336 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.077455 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.077835 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.077838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.077839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.078049 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:05.078161 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.078745 (+ 584us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.078900 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 15:44:05.079922 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.065955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:56347)
0809 15:44:05.066467 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.066511 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.067740 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.068266 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.068273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.068649 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:05.069136 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.069150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.070031 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.070034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.071006 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.071017 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.071744 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.071750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.071974 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.072619 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:05.072647 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:05.074414 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:05.076903 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:05.076908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:05.076922 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:05.077191 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:05.077564 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:05.077566 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:05.077567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:05.077705 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:05.078160 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:05.078167 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:05.078487 (+ 320us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.078682 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.079031 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":116,"threads_started":1}
I20260809 15:44:05.081194 5763 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:44:05.081492 5763 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:05.082170 5763 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
I20260809 15:44:05.083441 5268 ts_manager.cc:194] Registered new tserver with Master: 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
I20260809 15:44:05.084362 5268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:56347
W20260809 15:44:05.194625 5766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:05.194887 5766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:05.194931 5766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:05.198832 5766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:05.198884 5766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:05.198939 5766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:05.204288 5766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:39585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=43613
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:05.205386 5766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:05.206434 5766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:44:05.216323 5766 server_base.cc:1034] running on GCE node
W20260809 15:44:05.216260 5773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:05.216253 5778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:05.216260 5774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:05.216902 5766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:05.217592 5766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:05.218779 5766 hybrid_clock.cc:648] HybridClock initialized: now 1786290245218764 us; error 29 us; skew 500 ppm
Aug 09 15:44:05 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290245, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:05.221554 5766 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:44:05.222499 5766 webserver.cc:460] Webserver started at http://127.14.15.131:43613/ using document root <none> and password file <none>
I20260809 15:44:05.223074 5766 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:05.223182 5766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:05.227116 5766 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:44:05.229328 5790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.230792 5766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:05.230933 5766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "88f0e86858894686af800ed5156569db"
format_stamp: "Formatted at 2026-08-09 15:43:44 on dist-test-slave-jztv"
server_key: "155e24769a0338c581ec45caf28bda2b"
server_key_iv: "f97e609b285f620d3af4fc953f8d91f4"
server_key_version: "encryptionkey@0"
I20260809 15:44:05.231567 5766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:05.253381 5766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:05.256758 5766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:05.256979 5766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:05.257622 5766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:05.258535 5766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:05.258606 5766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.258678 5766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:05.258724 5766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:05.268285 5766 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:39585
I20260809 15:44:05.268312 5964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:39585 every 8 connection(s)
I20260809 15:44:05.269352 5766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:05.271369 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 5766
Aug 09 15:44:05 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290245, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:05.283439 5969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.272047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44358 (local address 127.14.15.190:46373)
0809 15:44:05.272286 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.272290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.272605 (+ 315us) server_negotiation.cc:407] Connection header received
0809 15:44:05.272754 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.272757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.272806 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.272925 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:05.273635 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.274496 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.275339 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.275728 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.275806 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.278484 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:05.278488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:05.278491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:05.278522 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:05.280909 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.281504 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.281510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.281513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.281649 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.281972 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.281975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.281977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.282270 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:05.282549 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.283017 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.283215 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":173,"spinlock_wait_cycles":26880,"thread_start_us":82,"threads_started":1}
I20260809 15:44:05.287442 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.271253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:35095 (local address 127.14.15.190:46373)
0809 15:44:05.271450 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.271457 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.272463 (+ 1006us) server_negotiation.cc:407] Connection header received
0809 15:44:05.274143 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.274146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.274187 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.274303 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:05.275602 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.276294 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.277443 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.277773 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.277897 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.281520 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:05.281565 (+ 45us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:05.281571 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:05.281696 (+ 125us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:05.283686 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.285133 (+ 1447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.285136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.285138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.285249 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.285722 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.285727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.285731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.285979 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:05.286092 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.286852 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.287042 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":69,"spinlock_wait_cycles":109440}
I20260809 15:44:05.288666 5968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.271708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:35095)
0809 15:44:05.272283 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.272345 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.273893 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.274481 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.274490 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.274888 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:05.275450 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.275469 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.276444 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.276447 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.277313 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.277323 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.277953 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.277956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.278107 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.278755 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:05.278782 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:05.280857 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:05.284248 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:05.284256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:05.284278 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:05.284985 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:05.285379 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:05.285403 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:05.285405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:05.285625 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:05.286116 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:05.286140 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:05.286539 (+ 399us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.286776 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.287179 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":157,"threads_started":1}
I20260809 15:44:05.290092 5965 heartbeater.cc:347] Connected to a master server at 127.14.15.190:46373
I20260809 15:44:05.290403 5965 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:05.290957 5965 heartbeater.cc:511] Master 127.14.15.190:46373 requested a full tablet report, sending...
I20260809 15:44:05.292083 5268 ts_manager.cc:194] Registered new tserver with Master: 88f0e86858894686af800ed5156569db (127.14.15.131:39585)
I20260809 15:44:05.292794 5268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:35095
I20260809 15:44:05.299518 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:05.304862 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.300377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57282 (local address 127.14.15.190:46373)
0809 15:44:05.300504 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.300508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.300625 (+ 117us) server_negotiation.cc:407] Connection header received
0809 15:44:05.300834 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.300839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.300996 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.301121 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:05.301484 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.302154 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.303261 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.303523 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.303655 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.304169 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:05.304365 (+ 196us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 15:44:05.304692 (+ 327us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57282: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 15:44:05.305004 5572 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57282: token expired
W20260809 15:44:05.305215 5149 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.15.190:46373)
I20260809 15:44:05.315099 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.305685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.14.15.190:46373)
0809 15:44:05.305816 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.305820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.305837 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:44:05.305938 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.305942 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.305997 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.306093 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:05.306825 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.307651 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.308987 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.309357 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.309469 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.311199 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:05.311203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:05.311206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:05.311239 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:05.313292 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.313736 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.313739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.313740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.313818 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:05.314100 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:05.314102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:05.314103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:05.314403 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:05.314545 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.314871 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.314976 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:44:05.317909 5268 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:05.321237 5268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:05.329406 5471 tablet_service.cc:1467] Processing CreateTablet for tablet ca32c1070c474effbd10cf0aec15841c (DEFAULT_TABLE table=test-table [id=32a4666d18da423794f0b0e7d1372d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:05.330160 5471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca32c1070c474effbd10cf0aec15841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:05.332988 5396 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Bootstrap starting.
I20260809 15:44:05.333732 5396 tablet_bootstrap.cc:654] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:05.334648 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.327951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:39585 (local address 127.0.0.1:48554)
0809 15:44:05.328073 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.328090 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.328172 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.329293 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.329299 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.329324 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:05.329440 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.329447 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.331288 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.331292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.332778 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.332792 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.333990 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.333995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.334138 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.334279 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.334360 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.334471 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":85}
I20260809 15:44:05.334823 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.328177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:35487 (local address 127.0.0.1:48986)
0809 15:44:05.328399 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.328408 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.328468 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.329388 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.329390 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.329403 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:05.329470 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.329480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.331347 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.331354 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.332835 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.332846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.334195 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.334199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.334376 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.334404 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.334485 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.334610 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":222,"thread_start_us":102,"threads_started":1}
I20260809 15:44:05.335268 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.328604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48986 (local address 127.14.15.130:35487)
0809 15:44:05.328908 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.328930 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.328955 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:44:05.329026 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.329032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.329236 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.329635 (+ 399us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:05.329856 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.331204 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.332962 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.333814 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.333969 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.334123 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.334976 (+ 853us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.335121 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":129,"threads_started":1}
I20260809 15:44:05.335430 5396 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: No bootstrap required, opened a new log
I20260809 15:44:05.335498 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.328131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48554 (local address 127.14.15.131:39585)
0809 15:44:05.328745 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.328760 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.328783 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:44:05.328863 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.328869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.329104 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.329280 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:05.329823 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.331151 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.332931 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.333814 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.333969 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.334123 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.335145 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.335241 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":146,"threads_started":1}
I20260809 15:44:05.335543 5396 ts_tablet_manager.cc:1397] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 15:44:05.336045 5396 raft_consensus.cc:348] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.336172 5396 raft_consensus.cc:374] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:05.336216 5396 raft_consensus.cc:729] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be13cf18958a44c3b70ceef231be8e0f, State: Initialized, Role: FOLLOWER
I20260809 15:44:05.336340 5396 consensus_queue.cc:260] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.336632 5396 ts_tablet_manager.cc:1428] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:44:05.338500 5669 tablet_service.cc:1467] Processing CreateTablet for tablet ca32c1070c474effbd10cf0aec15841c (DEFAULT_TABLE table=test-table [id=32a4666d18da423794f0b0e7d1372d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:05.338533 5862 tablet_service.cc:1467] Processing CreateTablet for tablet ca32c1070c474effbd10cf0aec15841c (DEFAULT_TABLE table=test-table [id=32a4666d18da423794f0b0e7d1372d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:05.339533 5669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca32c1070c474effbd10cf0aec15841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:05.339546 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca32c1070c474effbd10cf0aec15841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:05.345854 5988 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Bootstrap starting.
I20260809 15:44:05.346536 5991 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Bootstrap starting.
I20260809 15:44:05.348224 5991 tablet_bootstrap.cc:654] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:05.348519 5988 tablet_bootstrap.cc:654] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:05.349236 5988 log.cc:824] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:05.349339 5991 log.cc:824] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:05.351002 5988 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: No bootstrap required, opened a new log
I20260809 15:44:05.351012 5991 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: No bootstrap required, opened a new log
I20260809 15:44:05.351197 5988 ts_tablet_manager.cc:1397] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:44:05.351197 5991 ts_tablet_manager.cc:1397] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:44:05.354167 5991 raft_consensus.cc:348] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.354167 5988 raft_consensus.cc:348] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.354475 5991 raft_consensus.cc:374] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:05.354468 5988 raft_consensus.cc:374] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:05.354542 5988 raft_consensus.cc:729] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9637c938ed24415f97b7c565be6fd8a0, State: Initialized, Role: FOLLOWER
I20260809 15:44:05.354552 5991 raft_consensus.cc:729] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f0e86858894686af800ed5156569db, State: Initialized, Role: FOLLOWER
I20260809 15:44:05.354975 5988 consensus_queue.cc:260] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.354975 5991 consensus_queue.cc:260] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.355602 5763 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
I20260809 15:44:05.355602 5965 heartbeater.cc:503] Master 127.14.15.190:46373 was elected leader, sending a full tablet report...
I20260809 15:44:05.355958 5991 ts_tablet_manager.cc:1428] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:05.356884 5988 ts_tablet_manager.cc:1428] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260809 15:44:05.367203 5571 tablet.cc:2369] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:05.371217 5995 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:05.371359 5995 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.372444 5995 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289)
I20260809 15:44:05.375975 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.372607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:39585 (local address 127.14.15.130:46191)
0809 15:44:05.372719 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.372738 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.372820 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.373213 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.373216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.373234 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:05.373350 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.373355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.374066 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.374071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.374915 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.374925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.375550 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.375667 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.375685 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.375772 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.375841 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":22}
I20260809 15:44:05.375975 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.372797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:46191 (local address 127.14.15.131:39585)
0809 15:44:05.372998 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.373001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.373014 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:44:05.373056 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.373058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.373093 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.373185 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:05.373462 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.373957 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375041 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.375431 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375556 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.375608 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.375789 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.375856 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 15:44:05.376232 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.372810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:34999 (local address 127.14.15.129:37289)
0809 15:44:05.372944 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.372949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.373138 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:44:05.373276 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.373279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.373336 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.373430 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:05.373682 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.374199 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375252 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.375688 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375811 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.375951 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.376021 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.376107 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:44:05.376348 5996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.372726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37289 (local address 127.14.15.130:34999)
0809 15:44:05.373051 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.373061 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:05.373172 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:05.373441 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:05.373443 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:05.373459 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:05.373579 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.373585 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.374354 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.374359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.375132 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:05.375141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.375812 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.375815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:05.375906 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.375927 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:44:05.376006 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:44:05.376209 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":111,"threads_started":1}
I20260809 15:44:05.376873 5500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca32c1070c474effbd10cf0aec15841c" candidate_uuid: "9637c938ed24415f97b7c565be6fd8a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be13cf18958a44c3b70ceef231be8e0f" is_pre_election: true
I20260809 15:44:05.376955 5891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca32c1070c474effbd10cf0aec15841c" candidate_uuid: "9637c938ed24415f97b7c565be6fd8a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f0e86858894686af800ed5156569db" is_pre_election: true
I20260809 15:44:05.377198 5500 raft_consensus.cc:2454] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9637c938ed24415f97b7c565be6fd8a0 in term 0.
I20260809 15:44:05.377241 5891 raft_consensus.cc:2454] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9637c938ed24415f97b7c565be6fd8a0 in term 0.
I20260809 15:44:05.377686 5601 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9637c938ed24415f97b7c565be6fd8a0, be13cf18958a44c3b70ceef231be8e0f; no voters:
I20260809 15:44:05.377972 5995 raft_consensus.cc:2781] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:05.378057 5995 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:05.378103 5995 raft_consensus.cc:3037] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:05.379168 5995 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.379487 5995 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [CANDIDATE]: Term 1 election: Requested vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289)
I20260809 15:44:05.379845 5891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca32c1070c474effbd10cf0aec15841c" candidate_uuid: "9637c938ed24415f97b7c565be6fd8a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f0e86858894686af800ed5156569db"
I20260809 15:44:05.379845 5500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca32c1070c474effbd10cf0aec15841c" candidate_uuid: "9637c938ed24415f97b7c565be6fd8a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be13cf18958a44c3b70ceef231be8e0f"
I20260809 15:44:05.379969 5500 raft_consensus.cc:3037] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:05.379969 5891 raft_consensus.cc:3037] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:05.381249 5891 raft_consensus.cc:2454] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9637c938ed24415f97b7c565be6fd8a0 in term 1.
I20260809 15:44:05.381249 5500 raft_consensus.cc:2454] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9637c938ed24415f97b7c565be6fd8a0 in term 1.
I20260809 15:44:05.381549 5603 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 88f0e86858894686af800ed5156569db, 9637c938ed24415f97b7c565be6fd8a0, be13cf18958a44c3b70ceef231be8e0f; no voters:
I20260809 15:44:05.381788 5995 raft_consensus.cc:2781] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:05.382084 5995 raft_consensus.cc:686] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 1 LEADER]: Becoming Leader. State: Replica: 9637c938ed24415f97b7c565be6fd8a0, State: Running, Role: LEADER
I20260809 15:44:05.382510 5995 consensus_queue.cc:237] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:05.385613 5268 catalog_manager.cc:5495] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "9637c938ed24415f97b7c565be6fd8a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } health_report { overall_health: UNKNOWN } } }
I20260809 15:44:05.397552 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.394497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48990 (local address 127.14.15.130:35487)
0809 15:44:05.394611 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:05.394615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:05.394628 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:44:05.394706 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:05.394708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:05.394758 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:05.394837 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:05.395010 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.395510 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.396268 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:05.396498 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:05.396583 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:05.396835 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:05.397225 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:05.397314 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:05.397383 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 15:44:05.397432 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:44:05.403334 5500 raft_consensus.cc:1261] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Refusing update from remote peer 9637c938ed24415f97b7c565be6fd8a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:05.403358 5891 raft_consensus.cc:1261] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Refusing update from remote peer 9637c938ed24415f97b7c565be6fd8a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:05.404007 5997 consensus_queue.cc:1035] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:05.404217 5995 consensus_queue.cc:1035] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:05.419791 5267 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:05.419974 5267 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:05.422361 5267 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Sending DeleteTablet for 3 replicas of tablet ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:05.423080 5471 tablet_service.cc:1514] Processing DeleteTablet for tablet ca32c1070c474effbd10cf0aec15841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:05 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:57508
I20260809 15:44:05.423161 5862 tablet_service.cc:1514] Processing DeleteTablet for tablet ca32c1070c474effbd10cf0aec15841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:05 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:48554
I20260809 15:44:05.423166 5669 tablet_service.cc:1514] Processing DeleteTablet for tablet ca32c1070c474effbd10cf0aec15841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:05 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:48986
I20260809 15:44:05.423638 6016 tablet_replica.cc:330] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: stopping tablet replica
I20260809 15:44:05.423835 6017 tablet_replica.cc:330] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: stopping tablet replica
I20260809 15:44:05.423903 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 5331
I20260809 15:44:05.423978 6016 raft_consensus.cc:2229] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:05.431562 6016 raft_consensus.cc:2258] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:05.431531 6017 raft_consensus.cc:2229] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:05.432046 6017 raft_consensus.cc:2258] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:05.434278 6017 ts_tablet_manager.cc:1905] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:05.436394 6016 ts_tablet_manager.cc:1905] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:05.437628 6017 ts_tablet_manager.cc:1918] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:05.437824 6017 log.cc:1196] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:05.438328 6017 ts_tablet_manager.cc:1939] T ca32c1070c474effbd10cf0aec15841c P 9637c938ed24415f97b7c565be6fd8a0: Deleting consensus metadata
I20260809 15:44:05.439487 6016 ts_tablet_manager.cc:1918] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:05.439589 6016 log.cc:1196] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:05.439800 5238 catalog_manager.cc:4841] TS 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): tablet ca32c1070c474effbd10cf0aec15841c (table test-table [id=32a4666d18da423794f0b0e7d1372d31]) successfully deleted
I20260809 15:44:05.439973 6016 ts_tablet_manager.cc:1939] T ca32c1070c474effbd10cf0aec15841c P 88f0e86858894686af800ed5156569db: Deleting consensus metadata
I20260809 15:44:05.441030 5238 catalog_manager.cc:4841] TS 88f0e86858894686af800ed5156569db (127.14.15.131:39585): tablet ca32c1070c474effbd10cf0aec15841c (table test-table [id=32a4666d18da423794f0b0e7d1372d31]) successfully deleted
W20260809 15:44:05.445528 5236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:37289 (error 108)
I20260809 15:44:05.445662 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 5574
I20260809 15:44:05.446853 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:05.446461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37289 (local address 127.0.0.1:47314)
0809 15:44:05.446696 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:05.446758 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260809 15:44:05.447012 5236 catalog_manager.cc:4584] TS be13cf18958a44c3b70ceef231be8e0f (127.14.15.129:37289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca32c1070c474effbd10cf0aec15841c: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37289: connect: Connection refused (error 111)
I20260809 15:44:05.457041 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 5766
I20260809 15:44:05.472306 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 5211
I20260809 15:44:25.485396 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--webserver_interface=127.14.15.190
--webserver_port=37855
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:46373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:25.599470 6019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:25.599813 6019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:25.599890 6019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:25.604014 6019 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:44:25.604122 6019 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:44:25.604148 6019 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:44:25.604173 6019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:25.604249 6019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:25.604311 6019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:25.604352 6019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:25.604389 6019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:25.610639 6019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:46373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:46373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=37855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:25.611835 6019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:25.612931 6019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:44:25.622555 6019 server_base.cc:1034] running on GCE node
W20260809 15:44:25.622515 6029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:25.622524 6026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:25.622641 6031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:25.623335 6019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:25.624444 6019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:25.625620 6019 hybrid_clock.cc:648] HybridClock initialized: now 1786290265625607 us; error 27 us; skew 500 ppm
Aug 09 15:44:25 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:25.631840 6019 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:44:25.632876 6019 webserver.cc:460] Webserver started at http://127.14.15.190:37855/ using document root <none> and password file <none>
I20260809 15:44:25.633461 6019 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:25.633562 6019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:25.637665 6019 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:25.639919 6040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:25.641124 6019 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 15:44:25.641273 6019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "911b3800c7d94787af0f3a94ae2fc781"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "849e736a1dd0f962b58a5ee03cf01685"
server_key_iv: "05772d7b7944369d75ce5340a736ba0f"
server_key_version: "encryptionkey@0"
I20260809 15:44:25.641845 6019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:25.657711 6019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:25.661172 6019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:25.661397 6019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:25.668939 6019 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:46373
I20260809 15:44:25.669271 6116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:46373 every 8 connection(s)
I20260809 15:44:25.670058 6019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:25.673218 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 6019
I20260809 15:44:25.673679 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:37289
--local_ip_for_outbound_sockets=127.14.15.129
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=36225
--webserver_interface=127.14.15.129
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:44:25.674724 6117 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:44:25.676456 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap starting.
I20260809 15:44:25.702608 6117 log.cc:824] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:25.717303 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:44:25.717742 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Bootstrap complete.
I20260809 15:44:25.723677 6117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:25.724195 6117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Initialized, Role: FOLLOWER
I20260809 15:44:25.724757 6117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:25.724913 6117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:25.725011 6117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:25.725128 6117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:44:25.727649 6117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:25.728068 6117 leader_election.cc:302] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911b3800c7d94787af0f3a94ae2fc781; no voters:
I20260809 15:44:25.728440 6117 leader_election.cc:288] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 15:44:25.728591 6122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:44:25.728858 6122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [term 3 LEADER]: Becoming Leader. State: Replica: 911b3800c7d94787af0f3a94ae2fc781, State: Running, Role: LEADER
I20260809 15:44:25.729187 6122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } }
I20260809 15:44:25.729755 6117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:25.730906 6125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911b3800c7d94787af0f3a94ae2fc781. Latest consensus state: current_term: 3 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:44:25.730906 6124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "911b3800c7d94787af0f3a94ae2fc781" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911b3800c7d94787af0f3a94ae2fc781" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 46373 } } }
I20260809 15:44:25.731055 6125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:25.731056 6124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:25.731433 6134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:25.736258 6134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:25.737164 6134 catalog_manager.cc:1259] Loaded cluster ID: 28148401a52d4520a9d79e3fe879e6fa
I20260809 15:44:25.737231 6134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:25.740612 6134 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:25.741495 6134 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Loaded TSK: 0
I20260809 15:44:25.741600 6134 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 911b3800c7d94787af0f3a94ae2fc781: Loaded TSK: 1
F20260809 15:44:25.742461 6134 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1b58e1e9ad google::LogMessage::Fail() at ??:0
@ 0x7f1b58e2188a google::LogMessage::SendToLog() at ??:0
@ 0x7f1b58e1e4de google::LogMessage::Flush() at ??:0
@ 0x7f1b58e1fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1b5bae218d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1b5badaf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1b637877bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1b6376199c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1b63762178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f1b637a3df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1b637c282b std::function<>::operator()() at ??:0
@ 0x7f1b63761b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f1b63762f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1b6375f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f1b637a3640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1b5b0703d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1b5b070c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f1b5b0723f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1b5b061512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1b5c6a56db start_thread at ??:0
@ 0x7f1b5791c61f clone at ??:0
W20260809 15:44:25.850392 6119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:25.850672 6119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:25.850718 6119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:25.854998 6119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:25.855062 6119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:25.855151 6119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:25.860831 6119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:37289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=36225
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:25.861986 6119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:25.863117 6119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:25.873209 6178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:25.873209 6179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:25.873571 6119 server_base.cc:1034] running on GCE node
W20260809 15:44:25.873502 6182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:25.874167 6119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:25.874866 6119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:25.876091 6119 hybrid_clock.cc:648] HybridClock initialized: now 1786290265876072 us; error 37 us; skew 500 ppm
Aug 09 15:44:25 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:25.879297 6119 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:44:25.880344 6119 webserver.cc:460] Webserver started at http://127.14.15.129:36225/ using document root <none> and password file <none>
I20260809 15:44:25.880941 6119 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:25.881006 6119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:25.885375 6119 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:25.888208 6190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:25.889636 6119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:25.889794 6119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "be13cf18958a44c3b70ceef231be8e0f"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "58d0cac70f05cc7e45966c1a3b7538cf"
server_key_iv: "e809c88de39554c491d5e39811dd4aeb"
server_key_version: "encryptionkey@0"
I20260809 15:44:25.890472 6119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:25.910368 6119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:25.913798 6119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:25.914022 6119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:25.914743 6119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:25.916033 6200 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:44:25.921643 6119 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:44:25.921746 6119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260809 15:44:25.921850 6119 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:44:25.923597 6119 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:44:25.923671 6119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 15:44:25.923983 6200 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Bootstrap starting.
I20260809 15:44:25.936348 6119 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:37289
I20260809 15:44:25.936374 6364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:37289 every 8 connection(s)
I20260809 15:44:25.937422 6119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:25.945484 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 6119
I20260809 15:44:25.946008 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:35487
--local_ip_for_outbound_sockets=127.14.15.130
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=35523
--webserver_interface=127.14.15.130
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:44:25.947119 6200 log.cc:824] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:25.955123 6200 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:44:25.955535 6200 tablet_bootstrap.cc:492] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Bootstrap complete.
I20260809 15:44:25.956701 6200 ts_tablet_manager.cc:1397] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Time spent bootstrapping tablet: real 0.033s user 0.026s sys 0.004s
I20260809 15:44:25.959342 6200 raft_consensus.cc:348] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:25.959806 6200 raft_consensus.cc:729] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: be13cf18958a44c3b70ceef231be8e0f, State: Initialized, Role: FOLLOWER
I20260809 15:44:25.960325 6200 consensus_queue.cc:260] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:25.961313 6200 ts_tablet_manager.cc:1428] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 15:44:25.996775 6371 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:44:25.939581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:33969)
0809 15:44:25.940121 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:25.940176 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:25.941032 (+ 856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:25.995976 (+ 54944us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":147,"threads_started":1}
W20260809 15:44:25.997417 6365 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:46373 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:46373: Client connection negotiation failed: client connection to 127.14.15.190:46373: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:44:25.998363 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:25.997986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:46175)
0809 15:44:25.998137 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:25.998276 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 15:44:25.999229 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:25.998992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:44911)
0809 15:44:25.999116 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:25.999174 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 15:44:25.999457 6365 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:44:26.077894 6373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:26.078137 6373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:26.078181 6373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:26.082172 6373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:26.082273 6373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:26.082391 6373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:26.087559 6373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:35487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=35523
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:26.088557 6373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:26.089550 6373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:26.099186 6386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:26.099224 6373 server_base.cc:1034] running on GCE node
W20260809 15:44:26.099151 6383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:26.099174 6382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:26.099793 6373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:26.100423 6373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:26.101629 6373 hybrid_clock.cc:648] HybridClock initialized: now 1786290266101617 us; error 30 us; skew 500 ppm
Aug 09 15:44:26 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:26.104462 6373 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:44:26.105384 6373 webserver.cc:460] Webserver started at http://127.14.15.130:35523/ using document root <none> and password file <none>
I20260809 15:44:26.105943 6373 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:26.106058 6373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:26.109797 6373 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:26.111832 6401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.112947 6373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:44:26.113088 6373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "9637c938ed24415f97b7c565be6fd8a0"
format_stamp: "Formatted at 2026-08-09 15:43:43 on dist-test-slave-jztv"
server_key: "afdb3afd3f76cc94192b68daf23d4665"
server_key_iv: "63610089950492ea58f42d7a140de142"
server_key_version: "encryptionkey@0"
I20260809 15:44:26.113623 6373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:26.136210 6373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:26.139232 6373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:26.139449 6373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:26.140059 6373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:26.140894 6373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:26.140967 6373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.141047 6373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:26.141099 6373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.150549 6373 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:35487
I20260809 15:44:26.150625 6578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:35487 every 8 connection(s)
I20260809 15:44:26.151580 6373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:26.155522 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.153701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:39673)
0809 15:44:26.154171 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.154353 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":114,"threads_started":1}
I20260809 15:44:26.155696 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 6373
W20260809 15:44:26.156184 6581 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:46373 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:46373: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
I20260809 15:44:26.156237 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:39585
--local_ip_for_outbound_sockets=127.14.15.131
--tserver_master_addrs=127.14.15.190:46373
--webserver_port=43613
--webserver_interface=127.14.15.131
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:44:26.156858 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.156632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:50133)
0809 15:44:26.156747 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.156804 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:44:26.157598 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.157397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:50717)
0809 15:44:26.157503 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.157548 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:44:26.157832 6581 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:44:26.269881 6587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:26.270196 6587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:26.270301 6587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:26.274394 6587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:26.274495 6587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:26.274592 6587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:26.280081 6587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:39585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=43613
--tserver_master_addrs=127.14.15.190:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:26.281741 6587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:26.283301 6587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:26.294456 6597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:26.294528 6599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:26.294695 6587 server_base.cc:1034] running on GCE node
W20260809 15:44:26.294543 6596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:26.295460 6587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:26.296175 6587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:26.297376 6587 hybrid_clock.cc:648] HybridClock initialized: now 1786290266297339 us; error 46 us; skew 500 ppm
Aug 09 15:44:26 dist-test-slave-jztv krb5kdc[4395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:26.300175 6587 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:44:26.301019 6587 webserver.cc:460] Webserver started at http://127.14.15.131:43613/ using document root <none> and password file <none>
I20260809 15:44:26.301544 6587 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:26.301605 6587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:26.305492 6587 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:26.307663 6607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.308916 6587 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:44:26.309039 6587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "88f0e86858894686af800ed5156569db"
format_stamp: "Formatted at 2026-08-09 15:43:44 on dist-test-slave-jztv"
server_key: "155e24769a0338c581ec45caf28bda2b"
server_key_iv: "f97e609b285f620d3af4fc953f8d91f4"
server_key_version: "encryptionkey@0"
I20260809 15:44:26.309588 6587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:26.348009 6587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:26.351639 6587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:26.351809 6587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:26.352381 6587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:26.353205 6587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:26.353255 6587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.353295 6587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:26.353317 6587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:26.362656 6587 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:39585
I20260809 15:44:26.362730 6784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:39585 every 8 connection(s)
I20260809 15:44:26.363722 6587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:26.364665 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 6587
I20260809 15:44:26.367769 6795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.365994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:52543)
0809 15:44:26.366500 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.366604 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":158,"threads_started":1}
W20260809 15:44:26.368218 6785 heartbeater.cc:644] Failed to heartbeat to 127.14.15.190:46373 (0 consecutive failures): Network error: Failed to ping master at 127.14.15.190:46373: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
I20260809 15:44:26.368901 6795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.368618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:36163)
0809 15:44:26.368769 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.368823 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 15:44:26.369586 6795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:26.369358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:35617)
0809 15:44:26.369484 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:26.369532 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 15:44:26.369858 6785 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:44:27.000712 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.000077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:35091)
0809 15:44:27.000455 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:27.000541 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":89,"threads_started":1}
I20260809 15:44:27.158877 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.158432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:44165)
0809 15:44:27.158708 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:27.158766 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":93,"threads_started":1}
I20260809 15:44:27.310031 6799 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:27.310308 6799 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:27.311829 6799 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
Aug 09 15:44:27 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.131@KRBTEST.COM
Aug 09 15:44:27 dist-test-slave-jztv krb5kdc[4395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290265, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.130@KRBTEST.COM
I20260809 15:44:27.328461 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.312009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:39585 (local address 127.14.15.129:43743)
0809 15:44:27.312179 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:27.312196 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:27.312300 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:27.314685 (+ 2385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:27.314694 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:27.315311 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:27.315881 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:27.315900 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.317847 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.317853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:27.319300 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:27.319315 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.320276 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.320280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:27.320368 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:27.321096 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:27.321125 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:27.323069 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:27.325573 (+ 2504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:27.325580 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:27.325595 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:27.325867 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:27.326263 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326267 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:27.326269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:27.326469 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:27.327444 (+ 975us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:27.327451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:27.327718 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 15:44:27.327931 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 15:44:27.328268 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":105,"spinlock_wait_cycles":3584}
I20260809 15:44:27.328503 6800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.312205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:43743 (local address 127.14.15.131:39585)
0809 15:44:27.312719 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:27.312731 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:27.312794 (+ 63us) server_negotiation.cc:407] Connection header received
0809 15:44:27.313723 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:27.313733 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:27.314196 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:27.314545 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:27.316133 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.317709 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.319453 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.320148 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.320318 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:27.323345 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:27.323352 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:27.323368 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:27.323402 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:27.325437 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326004 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:27.326009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:27.326013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:27.326137 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326606 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:27.326611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:27.326614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:27.327310 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:27.327479 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:27.328068 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 15:44:27.328339 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":123,"threads_started":1}
I20260809 15:44:27.329152 6801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.312277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:35487 (local address 127.14.15.129:38767)
0809 15:44:27.312703 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:27.312717 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:27.312843 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:27.315036 (+ 2193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:27.315039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:27.315302 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:27.315879 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:27.315896 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.317894 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.317896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:27.319023 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:27.319034 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.319912 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.319918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:27.320164 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:27.321120 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:27.321152 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:27.323385 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:27.326333 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326335 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:27.326337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:27.326563 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:27.326920 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326925 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:27.326927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:27.327010 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:27.327704 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:27.327710 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:27.327849 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 15:44:27.327973 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:44:27.328987 (+ 1014us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":883,"spinlock_wait_cycles":3840,"thread_start_us":92,"threads_started":1}
I20260809 15:44:27.329643 6802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.312623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:38767 (local address 127.14.15.130:35487)
0809 15:44:27.312954 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:27.312976 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:27.313009 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:44:27.313886 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:27.313894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:27.314195 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:27.314545 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:27.316119 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.317700 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.319149 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:27.319776 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:27.319940 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:27.323622 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:27.323631 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:27.323650 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:27.323697 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:27.326183 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:27.326687 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:27.326693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:27.326698 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:27.326820 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:27.327113 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:27.327116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:27.327118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:27.327579 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:27.327713 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:27.328285 (+ 572us) server_negotiation.cc:299] Negotiation successful
0809 15:44:27.329187 (+ 902us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":108,"threads_started":1}
W20260809 15:44:27.331346 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88f0e86858894686af800ed5156569db (127.14.15.131:39585): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
W20260809 15:44:27.331619 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:27.331687 6195 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be13cf18958a44c3b70ceef231be8e0f; no voters: 88f0e86858894686af800ed5156569db, 9637c938ed24415f97b7c565be6fd8a0
I20260809 15:44:27.332230 6799 raft_consensus.cc:2726] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:44:27.371038 6803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:27.370600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:45335)
0809 15:44:27.370857 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:27.370909 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":87,"threads_started":1}
I20260809 15:44:28.001937 6804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:28.001514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:49265)
0809 15:44:28.001776 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:28.001833 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260809 15:44:28.160024 6805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:28.159639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:44539)
0809 15:44:28.159887 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:28.159941 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":74,"threads_started":1}
I20260809 15:44:28.372290 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:28.371837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:42411)
0809 15:44:28.372134 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:28.372191 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":104,"threads_started":1}
I20260809 15:44:29.003188 6809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:29.002746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:40597)
0809 15:44:29.003000 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:29.003057 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260809 15:44:29.161198 6810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:29.160763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:37171)
0809 15:44:29.161051 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:29.161109 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":75,"threads_started":1}
I20260809 15:44:29.373530 6812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:29.373096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:60909)
0809 15:44:29.373365 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:29.373426 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":82,"threads_started":1}
I20260809 15:44:29.531186 6814 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:29.531337 6814 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:29.531831 6814 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
W20260809 15:44:29.532932 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88f0e86858894686af800ed5156569db (127.14.15.131:39585): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
W20260809 15:44:29.533043 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:29.533124 6195 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be13cf18958a44c3b70ceef231be8e0f; no voters: 88f0e86858894686af800ed5156569db, 9637c938ed24415f97b7c565be6fd8a0
I20260809 15:44:29.533322 6814 raft_consensus.cc:2726] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:44:30.004602 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:30.004099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:41021)
0809 15:44:30.004416 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:30.004493 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":98,"threads_started":1}
I20260809 15:44:30.162444 6817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:30.161957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:58713)
0809 15:44:30.162297 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:30.162353 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":79,"threads_started":1}
I20260809 15:44:30.374946 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:30.374522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:48497)
0809 15:44:30.374783 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:30.374841 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
I20260809 15:44:31.006366 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:31.005784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:34405)
0809 15:44:31.006170 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:31.006264 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":101,"threads_started":1}
I20260809 15:44:31.163944 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:31.163445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:50821)
0809 15:44:31.163771 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:31.163842 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":88,"threads_started":1}
I20260809 15:44:31.376466 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:31.375937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:39953)
0809 15:44:31.376274 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:31.376341 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":121,"threads_started":1}
I20260809 15:44:32.007776 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:32.007252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:50995)
0809 15:44:32.007605 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:32.007670 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":115,"threads_started":1}
I20260809 15:44:32.165128 6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:32.164723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:38005)
0809 15:44:32.164971 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:32.165034 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
I20260809 15:44:32.377832 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:32.377356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:52431)
0809 15:44:32.377670 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:32.377732 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":114,"threads_started":1}
I20260809 15:44:32.764259 6827 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:32.764410 6827 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:32.765038 6827 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
W20260809 15:44:32.765951 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88f0e86858894686af800ed5156569db (127.14.15.131:39585): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
W20260809 15:44:32.766108 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:32.766176 6195 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be13cf18958a44c3b70ceef231be8e0f; no voters: 88f0e86858894686af800ed5156569db, 9637c938ed24415f97b7c565be6fd8a0
I20260809 15:44:32.766386 6827 raft_consensus.cc:2726] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:44:33.009296 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:33.008711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:52679)
0809 15:44:33.009070 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:33.009152 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":77,"threads_started":1}
I20260809 15:44:33.166608 6830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:33.166026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:55993)
0809 15:44:33.166418 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:33.166482 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":105,"threads_started":1}
I20260809 15:44:33.379173 6831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:33.378676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:57103)
0809 15:44:33.379003 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:33.379073 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":93,"threads_started":1}
I20260809 15:44:34.011814 6832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:34.010299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:46743)
0809 15:44:34.011556 (+ 1257us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:34.011675 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1150,"thread_start_us":1023,"threads_started":1}
I20260809 15:44:34.167927 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:34.167450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:44665)
0809 15:44:34.167762 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:34.167825 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":106,"threads_started":1}
I20260809 15:44:34.380494 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:34.379987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:38453)
0809 15:44:34.380323 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:34.380393 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":115,"threads_started":1}
I20260809 15:44:35.013240 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:35.012671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:51243)
0809 15:44:35.013001 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:35.013134 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":100,"threads_started":1}
I20260809 15:44:35.169212 6836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:35.168767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:44017)
0809 15:44:35.169043 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:35.169115 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":83,"threads_started":1}
I20260809 15:44:35.381963 6837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:35.381425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:44697)
0809 15:44:35.381763 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:35.381831 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":137,"threads_started":1}
I20260809 15:44:36.014825 6840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:36.014310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:57163)
0809 15:44:36.014655 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:36.014721 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":95,"threads_started":1}
I20260809 15:44:36.170781 6842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:36.170181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:46155)
0809 15:44:36.170619 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:36.170679 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":130,"threads_started":1}
I20260809 15:44:36.383203 6843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:36.382770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:59963)
0809 15:44:36.383047 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:36.383104 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":83,"threads_started":1}
I20260809 15:44:36.811299 6845 raft_consensus.cc:482] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:36.811460 6845 raft_consensus.cc:504] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f0e86858894686af800ed5156569db" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 39585 } } peers { permanent_uuid: "9637c938ed24415f97b7c565be6fd8a0" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 35487 } } peers { permanent_uuid: "be13cf18958a44c3b70ceef231be8e0f" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37289 } }
I20260809 15:44:36.811896 6845 leader_election.cc:288] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88f0e86858894686af800ed5156569db (127.14.15.131:39585), 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487)
W20260809 15:44:36.812821 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9637c938ed24415f97b7c565be6fd8a0 (127.14.15.130:35487): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
W20260809 15:44:36.813004 6195 leader_election.cc:341] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88f0e86858894686af800ed5156569db (127.14.15.131:39585): Not found: Tablet not found: ca32c1070c474effbd10cf0aec15841c
I20260809 15:44:36.813069 6195 leader_election.cc:302] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be13cf18958a44c3b70ceef231be8e0f; no voters: 88f0e86858894686af800ed5156569db, 9637c938ed24415f97b7c565be6fd8a0
I20260809 15:44:36.813232 6845 raft_consensus.cc:2726] T ca32c1070c474effbd10cf0aec15841c P be13cf18958a44c3b70ceef231be8e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:44:37.016239 6847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:37.015775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:44853)
0809 15:44:37.016061 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:37.016125 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":104,"threads_started":1}
I20260809 15:44:37.172135 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:37.171646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:33507)
0809 15:44:37.171968 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:37.172034 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":85,"threads_started":1}
I20260809 15:44:37.384727 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:37.384224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:37619)
0809 15:44:37.384515 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:37.384594 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":105,"threads_started":1}
I20260809 15:44:38.017867 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:38.017301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:34587)
0809 15:44:38.017637 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:38.017735 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":138,"threads_started":1}
I20260809 15:44:38.173317 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:38.172911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:57987)
0809 15:44:38.173168 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:38.173221 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260809 15:44:38.386059 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:38.385601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:52741)
0809 15:44:38.385889 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:38.385955 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":104,"threads_started":1}
I20260809 15:44:39.019281 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:39.018851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:47309)
0809 15:44:39.019113 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:39.019170 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":89,"threads_started":1}
I20260809 15:44:39.174739 6858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:39.174289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:34793)
0809 15:44:39.174570 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:39.174639 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":109,"threads_started":1}
I20260809 15:44:39.387266 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:39.386839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:50995)
0809 15:44:39.387113 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:39.387171 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":79,"threads_started":1}
I20260809 15:44:40.020617 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:40.020170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:58999)
0809 15:44:40.020451 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:40.020511 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260809 15:44:40.175958 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:40.175545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:39233)
0809 15:44:40.175801 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:40.175860 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":83,"threads_started":1}
I20260809 15:44:40.388554 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:40.388088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:57299)
0809 15:44:40.388382 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:40.388449 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":137,"threads_started":1}
I20260809 15:44:41.022063 6863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:41.021601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.129:35569)
0809 15:44:41.021888 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:41.021960 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260809 15:44:41.177205 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:41.176773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.130:51091)
0809 15:44:41.177047 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:41.177102 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":99,"threads_started":1}
I20260809 15:44:41.373168 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 6119
I20260809 15:44:41.391752 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:41.390110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:46373 (local address 127.14.15.131:54487)
0809 15:44:41.391542 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:41.391615 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.190:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1336,"thread_start_us":613,"threads_started":1}
I20260809 15:44:41.408316 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 6373
I20260809 15:44:41.425511 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 6587
2026-08-09T15:44:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59503 ms)
[----------] 30 tests from SecurityITest (257821 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:41 dist-test-slave-jztv krb5kdc[6870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:41 dist-test-slave-jztv krb5kdc[6870](info): set up 2 sockets
Aug 09 15:44:41 dist-test-slave-jztv krb5kdc[6870](info): commencing operation
krb5kdc: starting...
W20260809 15:44:42.652994 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:42 dist-test-slave-jztv krb5kdc[6870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:44:42.787618 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:40873
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:40873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:42.903384 6894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:42.903710 6894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:42.903784 6894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:42.907860 6894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:42.907963 6894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:42.908001 6894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:42.908063 6894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:42.908103 6894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:42.913414 6894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:40873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:40873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:42.914660 6894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:42.915760 6894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:44:42.925199 6894 server_base.cc:1034] running on GCE node
W20260809 15:44:42.925112 6907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:42.925122 6901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:42.925128 6899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:42.926081 6894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:42.927312 6894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:42.928543 6894 hybrid_clock.cc:648] HybridClock initialized: now 1786290282928514 us; error 47 us; skew 500 ppm
Aug 09 15:44:42 dist-test-slave-jztv krb5kdc[6870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290282, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:42.935271 6894 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:44:42.936254 6894 webserver.cc:460] Webserver started at http://127.14.15.190:43001/ using document root <none> and password file <none>
I20260809 15:44:42.936857 6894 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:42.936954 6894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:42.937206 6894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:42.939425 6894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "25cc8b05d7aa43f0b2dac5ade59e5836"
format_stamp: "Formatted at 2026-08-09 15:44:42 on dist-test-slave-jztv"
server_key: "ada4b705ac4cf8cf7c1e0fbb695df8ca"
server_key_iv: "a8e35063992c906573dcdf903cf5b1d8"
server_key_version: "encryptionkey@0"
I20260809 15:44:42.940025 6894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "25cc8b05d7aa43f0b2dac5ade59e5836"
format_stamp: "Formatted at 2026-08-09 15:44:42 on dist-test-slave-jztv"
server_key: "ada4b705ac4cf8cf7c1e0fbb695df8ca"
server_key_iv: "a8e35063992c906573dcdf903cf5b1d8"
server_key_version: "encryptionkey@0"
I20260809 15:44:42.943982 6894 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:44:42.946593 6914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:42.947875 6894 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:42.948024 6894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "25cc8b05d7aa43f0b2dac5ade59e5836"
format_stamp: "Formatted at 2026-08-09 15:44:42 on dist-test-slave-jztv"
server_key: "ada4b705ac4cf8cf7c1e0fbb695df8ca"
server_key_iv: "a8e35063992c906573dcdf903cf5b1d8"
server_key_version: "encryptionkey@0"
I20260809 15:44:42.948137 6894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:42.972721 6894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:42.976055 6894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:42.976275 6894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:42.983865 6894 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:40873
I20260809 15:44:42.983877 6982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:40873 every 8 connection(s)
I20260809 15:44:42.984949 6894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:42.987937 6983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:42.993759 6983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: Bootstrap starting.
I20260809 15:44:42.995234 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 6894
I20260809 15:44:42.995349 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:42.995666 14398 external_mini_cluster.cc:1428] Setting key 878e9d2f8666d2e5563425914377d2e0
I20260809 15:44:42.996690 6983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:42.997462 6983 log.cc:824] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:42.999738 6983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: No bootstrap required, opened a new log
I20260809 15:44:43.004330 6983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } }
I20260809 15:44:43.004630 6983 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:43.004714 6983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25cc8b05d7aa43f0b2dac5ade59e5836, State: Initialized, Role: FOLLOWER
Aug 09 15:44:42 dist-test-slave-jztv krb5kdc[6870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:43.005220 6983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } }
I20260809 15:44:43.005379 6983 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:43.005470 6983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:43.005578 6983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:43.006811 6983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } }
I20260809 15:44:43.007205 6983 leader_election.cc:302] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25cc8b05d7aa43f0b2dac5ade59e5836; no voters:
I20260809 15:44:43.007572 6983 leader_election.cc:288] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:43.007668 6990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:43.007882 6990 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [term 1 LEADER]: Becoming Leader. State: Replica: 25cc8b05d7aa43f0b2dac5ade59e5836, State: Running, Role: LEADER
I20260809 15:44:43.008255 6990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } }
I20260809 15:44:43.008967 6983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:43.010239 6992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } } }
I20260809 15:44:43.010375 6993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25cc8b05d7aa43f0b2dac5ade59e5836. Latest consensus state: current_term: 1 leader_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cc8b05d7aa43f0b2dac5ade59e5836" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40873 } } }
I20260809 15:44:43.010476 6992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:43.010526 6993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:43.010977 7007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:43.011315 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:42.996810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.14.15.190:40873)
0809 15:44:42.997296 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:42.997311 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:42.997345 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:44:42.998068 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:42.998087 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:42.998473 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:42.998744 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:42.999673 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.000677 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.001886 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.002444 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.002566 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.005637 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:43.005642 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:43.005656 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:43.005710 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:43.007660 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.008254 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.008260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.008265 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.008410 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.008700 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.008705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.008707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.009224 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:43.009446 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.009730 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.010083 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":174,"threads_started":1}
I20260809 15:44:43.014102 7007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:43.019577 7007 catalog_manager.cc:1347] Generated new cluster ID: db6b2aa9e1344d79ba03449f971dedf9
I20260809 15:44:43.019647 7007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:43.034257 7007 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:43.035378 7007 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:43.041355 7007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: Generated new TSK 0
I20260809 15:44:43.042061 7007 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:44:43.077652 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:43.196463 7021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:43.196760 7021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:43.196805 7021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:43.200953 7021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:43.201026 7021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:43.201087 7021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:43.206792 7021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:43.207969 7021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:43.209076 7021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:43.219390 7033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:43.219555 7021 server_base.cc:1034] running on GCE node
W20260809 15:44:43.219439 7036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:43.219391 7031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:43.220126 7021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:43.220763 7021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:43.221936 7021 hybrid_clock.cc:648] HybridClock initialized: now 1786290283221919 us; error 27 us; skew 500 ppm
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:43.224893 7021 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:44:43.225761 7021 webserver.cc:460] Webserver started at http://127.14.15.129:43145/ using document root <none> and password file <none>
I20260809 15:44:43.226362 7021 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:43.226431 7021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:43.226613 7021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:43.228616 7021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "171503b774614ec3b9df45194381ab57"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "3bc5a46cf8fa5459b259a2efdc877332"
server_key_iv: "f9025c62ddf74409591544ddca0929ec"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.229159 7021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "171503b774614ec3b9df45194381ab57"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "3bc5a46cf8fa5459b259a2efdc877332"
server_key_iv: "f9025c62ddf74409591544ddca0929ec"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.232812 7021 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:44:43.235324 7044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.236563 7021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:43.236706 7021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "171503b774614ec3b9df45194381ab57"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "3bc5a46cf8fa5459b259a2efdc877332"
server_key_iv: "f9025c62ddf74409591544ddca0929ec"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.236822 7021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:43.252830 7021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:43.255823 7021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:43.256032 7021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:43.256753 7021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:43.257674 7021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:43.257722 7021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.257761 7021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:43.257786 7021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.266855 7021 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:39547
I20260809 15:44:43.266891 7194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:39547 every 8 connection(s)
I20260809 15:44:43.267786 7021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:43.275645 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7021
I20260809 15:44:43.275794 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:43.276180 14398 external_mini_cluster.cc:1428] Setting key 11ef8e46d2d07e73987388c5f6ad5918
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:43.282424 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.269772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:49659 (local address 127.14.15.190:40873)
0809 15:44:43.269925 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.269930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.270848 (+ 918us) server_negotiation.cc:407] Connection header received
0809 15:44:43.272195 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.272198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.272248 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.272332 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:43.273488 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.274038 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.275172 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.275450 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.275548 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.278681 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:43.278685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:43.278687 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:43.278713 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:43.280251 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.280810 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.280813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.280815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.280893 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.281262 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.281265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.281267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.281455 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:43.281566 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.282096 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.282248 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:44:43.283310 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.270159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:40873 (local address 127.14.15.129:49659)
0809 15:44:43.270687 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.270741 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.271970 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.272493 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.272499 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.272841 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:43.273337 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.273351 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.274163 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.274165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.275042 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.275051 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.275651 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.275657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.275892 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.276602 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:43.276626 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:43.278466 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:43.280382 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.280388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.280404 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.280689 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.280999 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.281002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.281004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.281154 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.281572 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:43.281582 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:43.281835 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.282022 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.282404 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":132,"threads_started":1}
I20260809 15:44:43.284693 7196 heartbeater.cc:347] Connected to a master server at 127.14.15.190:40873
I20260809 15:44:43.284969 7196 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:43.285481 7196 heartbeater.cc:511] Master 127.14.15.190:40873 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:44:43.287221 6934 ts_manager.cc:194] Registered new tserver with Master: 171503b774614ec3b9df45194381ab57 (127.14.15.129:39547)
I20260809 15:44:43.288401 6934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:49659
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:44:43.306959 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:43.422763 7203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:43.423035 7203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:43.423121 7203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:43.427264 7203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:43.427326 7203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:43.427438 7203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:43.432876 7203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:43.434042 7203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:43.435154 7203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:43.445392 7211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:43.445348 7208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:43.445396 7209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:43.445611 7203 server_base.cc:1034] running on GCE node
I20260809 15:44:43.446074 7203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:43.446805 7203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:43.448004 7203 hybrid_clock.cc:648] HybridClock initialized: now 1786290283447986 us; error 30 us; skew 500 ppm
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:43.450845 7203 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:44:43.451905 7203 webserver.cc:460] Webserver started at http://127.14.15.130:38899/ using document root <none> and password file <none>
I20260809 15:44:43.452520 7203 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:43.452630 7203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:43.452917 7203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:43.455173 7203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "c7237ae5d6a8daa9c65f4e00879b74e8"
server_key_iv: "adc89e9f6be1a8bc973677be26706494"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.455789 7203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "c7237ae5d6a8daa9c65f4e00879b74e8"
server_key_iv: "adc89e9f6be1a8bc973677be26706494"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.459717 7203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:44:43.462280 7224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.463514 7203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:43.463675 7203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "c7237ae5d6a8daa9c65f4e00879b74e8"
server_key_iv: "adc89e9f6be1a8bc973677be26706494"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.463798 7203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:43.488747 7203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:43.491992 7203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:43.492245 7203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:43.492918 7203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:43.493818 7203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:43.493896 7203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.493970 7203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:43.494016 7203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.503549 7203 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:34761
I20260809 15:44:43.503571 7388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:34761 every 8 connection(s)
I20260809 15:44:43.504493 7203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:43.505497 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7203
I20260809 15:44:43.505633 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:43.505970 14398 external_mini_cluster.cc:1428] Setting key ed0950cffc82f083ec75642aadb15ec2
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:44:43.520365 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.506547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:51385 (local address 127.14.15.190:40873)
0809 15:44:43.506715 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.506719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.507702 (+ 983us) server_negotiation.cc:407] Connection header received
0809 15:44:43.509152 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.509177 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.509236 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.509311 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:43.510913 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.511526 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.513324 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.513564 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.513654 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.516709 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:43.516713 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:43.516715 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:43.516739 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:43.518286 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.518796 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.518800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.518802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.518884 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.519239 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.519244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.519245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.519455 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:43.519564 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.520062 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.520195 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
I20260809 15:44:43.521345 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.506990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:40873 (local address 127.14.15.130:51385)
0809 15:44:43.507531 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.507592 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.508951 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.509510 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.509519 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.510058 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:43.510633 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.510647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.511666 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.511672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.513183 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.513200 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.513745 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.513750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.514015 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.514694 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:43.514722 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:43.516528 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:43.518399 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.518406 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.518421 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.518682 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.518977 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.518980 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.518982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.519142 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.519564 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:43.519572 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:43.519817 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.520021 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.520351 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":121,"threads_started":1}
I20260809 15:44:43.522679 7389 heartbeater.cc:347] Connected to a master server at 127.14.15.190:40873
I20260809 15:44:43.522953 7389 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:43.523471 7389 heartbeater.cc:511] Master 127.14.15.190:40873 requested a full tablet report, sending...
I20260809 15:44:43.524623 6934 ts_manager.cc:194] Registered new tserver with Master: 2621f8e3a3c24ee68e2395a5d0ca77a3 (127.14.15.130:34761)
I20260809 15:44:43.525209 6934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:51385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:44:43.537828 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:43.654322 7394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:43.654644 7394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:43.654738 7394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:43.658851 7394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:43.658939 7394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:43.659029 7394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:43.664556 7394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:43.665711 7394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:43.666893 7394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:43.676971 7404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:43.676963 7402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:43.676963 7406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:43.677167 7394 server_base.cc:1034] running on GCE node
I20260809 15:44:43.677654 7394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:43.678360 7394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:43.679562 7394 hybrid_clock.cc:648] HybridClock initialized: now 1786290283679541 us; error 32 us; skew 500 ppm
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:43.682533 7394 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:44:43.683415 7394 webserver.cc:460] Webserver started at http://127.14.15.131:41183/ using document root <none> and password file <none>
I20260809 15:44:43.684002 7394 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:43.684098 7394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:43.684340 7394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:43.686548 7394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "db4653ff845d46e8bc1a4e560874366d"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "486a9e7b607d688d6901554e7dccf153"
server_key_iv: "d885faa6dbc168662615d36d30ceb362"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.687129 7394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "db4653ff845d46e8bc1a4e560874366d"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "486a9e7b607d688d6901554e7dccf153"
server_key_iv: "d885faa6dbc168662615d36d30ceb362"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.691200 7394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:44:43.694285 7415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.695493 7394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:44:43.695641 7394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "db4653ff845d46e8bc1a4e560874366d"
format_stamp: "Formatted at 2026-08-09 15:44:43 on dist-test-slave-jztv"
server_key: "486a9e7b607d688d6901554e7dccf153"
server_key_iv: "d885faa6dbc168662615d36d30ceb362"
server_key_version: "encryptionkey@0"
I20260809 15:44:43.695771 7394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:43.714633 7394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:43.717746 7394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:43.717962 7394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:43.718617 7394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:43.719502 7394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:43.719578 7394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.719652 7394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:43.719695 7394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:43.728976 7394 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:46299
I20260809 15:44:43.729001 7592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:46299 every 8 connection(s)
I20260809 15:44:43.729938 7394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:43.735929 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7394
I20260809 15:44:43.736056 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:43.736390 14398 external_mini_cluster.cc:1428] Setting key 6240b4514a5742a7432b7f6457e6db79
Aug 09 15:44:43 dist-test-slave-jztv krb5kdc[6870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:43.743873 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.731740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:60485 (local address 127.14.15.190:40873)
0809 15:44:43.731915 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.731920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.732797 (+ 877us) server_negotiation.cc:407] Connection header received
0809 15:44:43.734116 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.734118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.734166 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.734307 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:43.735439 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.736234 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.737665 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.737963 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.738045 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.740687 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:43.740690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:43.740692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:43.740717 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:43.742062 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.742585 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.742588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.742590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.742666 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.742963 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.742965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.742966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.743142 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:43.743218 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.743658 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.743756 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:44:43.744657 7596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.732128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:40873 (local address 127.14.15.131:60485)
0809 15:44:43.732631 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.732680 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.733921 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.734470 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.734476 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.734817 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:43.735301 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.735315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.736365 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.736368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.737498 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.737509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.738119 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.738123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.738360 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.739011 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:43.739027 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:43.740455 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:43.742176 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.742180 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.742191 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.742497 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.742750 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:43.742752 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:43.742753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:43.742884 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:43.743230 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:43.743235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:43.743449 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.743608 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.743847 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":130,"threads_started":1}
I20260809 15:44:43.745767 7593 heartbeater.cc:347] Connected to a master server at 127.14.15.190:40873
I20260809 15:44:43.746001 7593 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:43.746613 7593 heartbeater.cc:511] Master 127.14.15.190:40873 requested a full tablet report, sending...
I20260809 15:44:43.747658 6934 ts_manager.cc:194] Registered new tserver with Master: db4653ff845d46e8bc1a4e560874366d (127.14.15.131:46299)
I20260809 15:44:43.748183 6934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:60485
I20260809 15:44:43.750392 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:43.759428 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.752523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.14.15.190:40873)
0809 15:44:43.752624 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.752628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.752869 (+ 241us) server_negotiation.cc:407] Connection header received
0809 15:44:43.753004 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.753006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.753042 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.753105 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:43.753875 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.754439 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.755236 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.755443 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.755519 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.756776 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:43.756779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:43.756781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:43.756803 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:43.758025 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.758452 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.758455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.758456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.758531 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:43.758759 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:43.758760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:43.758761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:43.758945 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:43.759044 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.759211 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.759299 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:44:43.762277 6934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:43.765247 6934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:43.779444 7611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.774124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34761 (local address 127.0.0.1:34026)
0809 15:44:43.774390 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.774404 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.774494 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.775377 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.775383 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.775400 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:43.775513 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.775520 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776943 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.776945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.777781 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.777791 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.778880 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.778884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.779004 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.779049 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.779163 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.779277 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":131,"threads_started":1}
I20260809 15:44:43.779513 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.774570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.14.15.130:34761)
0809 15:44:43.774921 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.774935 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.774956 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:44:43.775025 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.775030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.775233 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.775374 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:43.775655 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776794 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.777914 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.778758 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.778880 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.779038 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.779228 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.779339 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":117,"threads_started":1}
I20260809 15:44:43.780211 7608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.773450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:46299 (local address 127.0.0.1:46518)
0809 15:44:43.774058 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.774072 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.774159 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.775676 (+ 1517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.775678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.775692 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:43.775770 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.775774 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776787 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.776791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.778140 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.778152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.779475 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.779479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.779892 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.779922 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.780002 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.780074 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":56,"thread_start_us":130,"threads_started":1}
I20260809 15:44:43.780411 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.773462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36590 (local address 127.14.15.129:39547)
0809 15:44:43.774411 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.774426 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.774450 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:44:43.774531 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.774540 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.774778 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.775293 (+ 515us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:43.775453 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776700 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.778795 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.779681 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.780000 (+ 319us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.780150 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.780202 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.780283 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":122,"threads_started":1}
I20260809 15:44:43.780716 7612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.774166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46518 (local address 127.14.15.131:46299)
0809 15:44:43.775087 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.775099 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.775123 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:44:43.775195 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.775198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.775369 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.775514 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:43.775886 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776645 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.778290 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.779130 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.779261 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.779407 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.780476 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.780587 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":124,"threads_started":1}
I20260809 15:44:43.781025 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.773348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:39547 (local address 127.0.0.1:36590)
0809 15:44:43.773683 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.773729 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.773844 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.774963 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.774971 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.774997 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:43.775128 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.775134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.776893 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.776896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.778669 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.778678 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.779996 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.779999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.780087 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.780110 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.780175 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.780242 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":78,"thread_start_us":108,"threads_started":1}
I20260809 15:44:43.782935 7300 tablet_service.cc:1467] Processing CreateTablet for tablet 1ec485b6be3b4c2482e18924decfee53 (DEFAULT_TABLE table=test-table [id=e5344f86b41b4173924df92306c3c693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:43.783288 7494 tablet_service.cc:1467] Processing CreateTablet for tablet 1ec485b6be3b4c2482e18924decfee53 (DEFAULT_TABLE table=test-table [id=e5344f86b41b4173924df92306c3c693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:43.784118 7300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ec485b6be3b4c2482e18924decfee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:43.783883 7105 tablet_service.cc:1467] Processing CreateTablet for tablet 1ec485b6be3b4c2482e18924decfee53 (DEFAULT_TABLE table=test-table [id=e5344f86b41b4173924df92306c3c693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:43.784349 7494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ec485b6be3b4c2482e18924decfee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:43.784837 7105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ec485b6be3b4c2482e18924decfee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:43.790290 7614 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Bootstrap starting.
I20260809 15:44:43.792124 7618 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Bootstrap starting.
I20260809 15:44:43.792740 7614 tablet_bootstrap.cc:654] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:43.793851 7618 tablet_bootstrap.cc:654] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:43.793849 7614 log.cc:824] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:43.794505 7621 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: Bootstrap starting.
I20260809 15:44:43.795079 7618 log.cc:824] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:43.796032 7614 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: No bootstrap required, opened a new log
I20260809 15:44:43.796231 7614 ts_tablet_manager.cc:1397] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:44:43.796599 7621 tablet_bootstrap.cc:654] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:43.796905 7618 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: No bootstrap required, opened a new log
I20260809 15:44:43.797153 7618 ts_tablet_manager.cc:1397] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:43.797475 7621 log.cc:824] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:43.799444 7621 tablet_bootstrap.cc:492] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: No bootstrap required, opened a new log
I20260809 15:44:43.799629 7621 ts_tablet_manager.cc:1397] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 15:44:43.800215 7614 raft_consensus.cc:348] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.800486 7614 raft_consensus.cc:374] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:43.800588 7614 raft_consensus.cc:729] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db4653ff845d46e8bc1a4e560874366d, State: Initialized, Role: FOLLOWER
I20260809 15:44:43.800702 7618 raft_consensus.cc:348] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.800976 7618 raft_consensus.cc:374] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:43.801043 7618 raft_consensus.cc:729] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2621f8e3a3c24ee68e2395a5d0ca77a3, State: Initialized, Role: FOLLOWER
I20260809 15:44:43.801054 7614 consensus_queue.cc:260] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.801523 7618 consensus_queue.cc:260] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.801788 7593 heartbeater.cc:503] Master 127.14.15.190:40873 was elected leader, sending a full tablet report...
I20260809 15:44:43.802112 7614 ts_tablet_manager.cc:1428] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:44:43.802546 7618 ts_tablet_manager.cc:1428] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:43.802909 7389 heartbeater.cc:503] Master 127.14.15.190:40873 was elected leader, sending a full tablet report...
I20260809 15:44:43.804683 7621 raft_consensus.cc:348] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.804919 7621 raft_consensus.cc:374] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:43.805025 7621 raft_consensus.cc:729] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171503b774614ec3b9df45194381ab57, State: Initialized, Role: FOLLOWER
I20260809 15:44:43.805539 7621 consensus_queue.cc:260] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.806406 7621 ts_tablet_manager.cc:1428] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: Time spent starting tablet: real 0.007s user 0.000s sys 0.007s
I20260809 15:44:43.806771 7196 heartbeater.cc:503] Master 127.14.15.190:40873 was elected leader, sending a full tablet report...
I20260809 15:44:43.921316 7631 raft_consensus.cc:482] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:43.921607 7631 raft_consensus.cc:504] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.922973 7631 leader_election.cc:288] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db4653ff845d46e8bc1a4e560874366d (127.14.15.131:46299), 2621f8e3a3c24ee68e2395a5d0ca77a3 (127.14.15.130:34761)
I20260809 15:44:43.927510 7612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.923349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:40249 (local address 127.14.15.131:46299)
0809 15:44:43.923497 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.923502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.923849 (+ 347us) server_negotiation.cc:407] Connection header received
0809 15:44:43.924001 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.924003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.924048 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.924149 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:43.924458 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.925082 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.926520 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.926919 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.927052 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.927109 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.927296 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.927364 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:44:43.927559 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.923355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:50437 (local address 127.14.15.130:34761)
0809 15:44:43.923496 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.923501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.923761 (+ 260us) server_negotiation.cc:407] Connection header received
0809 15:44:43.923973 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.923978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.924046 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.924136 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:43.924509 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.924998 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.926554 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.926951 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.927087 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.927139 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.927335 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.927413 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:44:43.927579 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.923280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34761 (local address 127.14.15.129:50437)
0809 15:44:43.923657 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.923669 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.923819 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.924169 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.924173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.924192 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:43.924355 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.924361 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.925168 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.925171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.926416 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.926426 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.927084 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.927088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.927188 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.927217 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.927301 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.927380 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":83,"thread_start_us":128,"threads_started":1}
I20260809 15:44:43.927585 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.923285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:46299 (local address 127.14.15.129:40249)
0809 15:44:43.923752 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:43.923764 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:43.923861 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:43.924159 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:43.924162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:43.924182 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:43.924340 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.924346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.925197 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.925201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.926400 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:43.926410 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.927049 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.927053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:43.927159 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.927183 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:44:43.927278 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 15:44:43.927355 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":7,"spinlock_wait_cycles":11648,"thread_start_us":124,"threads_started":1}
I20260809 15:44:43.928242 7324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ec485b6be3b4c2482e18924decfee53" candidate_uuid: "171503b774614ec3b9df45194381ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" is_pre_election: true
I20260809 15:44:43.928624 7324 raft_consensus.cc:2454] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171503b774614ec3b9df45194381ab57 in term 0.
I20260809 15:44:43.928685 7518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ec485b6be3b4c2482e18924decfee53" candidate_uuid: "171503b774614ec3b9df45194381ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db4653ff845d46e8bc1a4e560874366d" is_pre_election: true
I20260809 15:44:43.928932 7518 raft_consensus.cc:2454] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171503b774614ec3b9df45194381ab57 in term 0.
I20260809 15:44:43.929183 7046 leader_election.cc:302] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171503b774614ec3b9df45194381ab57, 2621f8e3a3c24ee68e2395a5d0ca77a3; no voters:
I20260809 15:44:43.929515 7631 raft_consensus.cc:2781] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:43.929634 7631 raft_consensus.cc:482] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:43.929693 7631 raft_consensus.cc:3037] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:43.930877 7631 raft_consensus.cc:504] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.931252 7631 leader_election.cc:288] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [CANDIDATE]: Term 1 election: Requested vote from peers db4653ff845d46e8bc1a4e560874366d (127.14.15.131:46299), 2621f8e3a3c24ee68e2395a5d0ca77a3 (127.14.15.130:34761)
I20260809 15:44:43.931679 7518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ec485b6be3b4c2482e18924decfee53" candidate_uuid: "171503b774614ec3b9df45194381ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db4653ff845d46e8bc1a4e560874366d"
I20260809 15:44:43.931679 7324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ec485b6be3b4c2482e18924decfee53" candidate_uuid: "171503b774614ec3b9df45194381ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3"
I20260809 15:44:43.931815 7518 raft_consensus.cc:3037] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:43.931815 7324 raft_consensus.cc:3037] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:43.933254 7518 raft_consensus.cc:2454] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171503b774614ec3b9df45194381ab57 in term 1.
I20260809 15:44:43.933254 7324 raft_consensus.cc:2454] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171503b774614ec3b9df45194381ab57 in term 1.
I20260809 15:44:43.933656 7049 leader_election.cc:302] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171503b774614ec3b9df45194381ab57, db4653ff845d46e8bc1a4e560874366d; no voters:
I20260809 15:44:43.933861 7631 raft_consensus.cc:2781] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:43.934095 7631 raft_consensus.cc:686] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 1 LEADER]: Becoming Leader. State: Replica: 171503b774614ec3b9df45194381ab57, State: Running, Role: LEADER
I20260809 15:44:43.934548 7631 consensus_queue.cc:237] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } }
I20260809 15:44:43.937930 6931 catalog_manager.cc:5495] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171503b774614ec3b9df45194381ab57 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "171503b774614ec3b9df45194381ab57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171503b774614ec3b9df45194381ab57" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 39547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 } health_report { overall_health: UNKNOWN } } }
I20260809 15:44:43.971380 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:43.967697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.14.15.129:39547)
0809 15:44:43.967835 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:43.967839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:43.967853 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:44:43.967932 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:43.967934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:43.967998 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:43.968091 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:43.968335 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.968912 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.969758 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:43.970025 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:43.970107 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:43.970526 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:43.970967 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:43.971073 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:43.971149 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 15:44:43.971201 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:44:43.977325 7518 raft_consensus.cc:1261] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 1 FOLLOWER]: Refusing update from remote peer 171503b774614ec3b9df45194381ab57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:43.977325 7324 raft_consensus.cc:1261] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 1 FOLLOWER]: Refusing update from remote peer 171503b774614ec3b9df45194381ab57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:43.978116 7635 consensus_queue.cc:1035] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db4653ff845d46e8bc1a4e560874366d" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 46299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:43.978382 7631 consensus_queue.cc:1035] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2621f8e3a3c24ee68e2395a5d0ca77a3" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:44:43.980902 7595 tablet.cc:2369] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:43.994352 7641 mvcc.cc:205] Tried to move back new op lower bound from 7316645003163680768 to 7316645002998820864. Current Snapshot: MvccSnapshot[applied={T|T < 7316645003163680768 or (T in {7316645003163680768})}]
I20260809 15:44:43.996140 6934 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:43.996294 6934 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:43.998776 6934 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25cc8b05d7aa43f0b2dac5ade59e5836: Sending DeleteTablet for 3 replicas of tablet 1ec485b6be3b4c2482e18924decfee53
I20260809 15:44:43.999761 7300 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ec485b6be3b4c2482e18924decfee53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:43 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:34026
I20260809 15:44:43.999766 7105 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ec485b6be3b4c2482e18924decfee53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:43 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:36590
I20260809 15:44:44.000499 7649 tablet_replica.cc:330] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57: stopping tablet replica
I20260809 15:44:44.000615 7494 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ec485b6be3b4c2482e18924decfee53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:43 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:46518
I20260809 15:44:44.000844 7649 raft_consensus.cc:2229] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:44.001178 7649 raft_consensus.cc:2258] T 1ec485b6be3b4c2482e18924decfee53 P 171503b774614ec3b9df45194381ab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:44.001307 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7021
I20260809 15:44:44.005822 7652 tablet_replica.cc:330] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: stopping tablet replica
I20260809 15:44:44.006145 7652 raft_consensus.cc:2229] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:44.006568 7652 raft_consensus.cc:2258] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:44.006971 7651 tablet_replica.cc:330] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: stopping tablet replica
I20260809 15:44:44.007257 7651 raft_consensus.cc:2229] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:44.007614 7651 raft_consensus.cc:2258] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:44.008248 7652 ts_tablet_manager.cc:1905] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:44.009020 7651 ts_tablet_manager.cc:1905] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:44.011379 7652 ts_tablet_manager.cc:1918] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:44.011502 7652 log.cc:1196] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/1ec485b6be3b4c2482e18924decfee53
I20260809 15:44:44.011857 7651 ts_tablet_manager.cc:1918] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:44.011912 7652 ts_tablet_manager.cc:1939] T 1ec485b6be3b4c2482e18924decfee53 P db4653ff845d46e8bc1a4e560874366d: Deleting consensus metadata
I20260809 15:44:44.011973 7651 log.cc:1196] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/1ec485b6be3b4c2482e18924decfee53
I20260809 15:44:44.012301 7651 ts_tablet_manager.cc:1939] T 1ec485b6be3b4c2482e18924decfee53 P 2621f8e3a3c24ee68e2395a5d0ca77a3: Deleting consensus metadata
I20260809 15:44:44.013288 6918 catalog_manager.cc:4841] TS db4653ff845d46e8bc1a4e560874366d (127.14.15.131:46299): tablet 1ec485b6be3b4c2482e18924decfee53 (table test-table [id=e5344f86b41b4173924df92306c3c693]) successfully deleted
I20260809 15:44:44.013334 6916 catalog_manager.cc:4841] TS 2621f8e3a3c24ee68e2395a5d0ca77a3 (127.14.15.130:34761): tablet 1ec485b6be3b4c2482e18924decfee53 (table test-table [id=e5344f86b41b4173924df92306c3c693]) successfully deleted
W20260809 15:44:44.014000 6915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:39547 (error 108)
I20260809 15:44:44.014262 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7203
I20260809 15:44:44.023223 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.022823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:39547 (local address 127.0.0.1:36614)
0809 15:44:44.023042 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.023125 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:39547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260809 15:44:44.023571 6915 catalog_manager.cc:4584] TS 171503b774614ec3b9df45194381ab57 (127.14.15.129:39547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ec485b6be3b4c2482e18924decfee53: Network error: Client connection negotiation failed: client connection to 127.14.15.129:39547: connect: Connection refused (error 111)
I20260809 15:44:44.030155 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7394
I20260809 15:44:44.048420 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 6894
2026-08-09T15:44:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2625 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T15:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:44Z Disabled control of system clock
I20260809 15:44:44.086331 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39829
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:44.196756 7660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:44.197010 7660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:44.197052 7660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:44.201151 7660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:44.201251 7660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:44.201282 7660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:44.201325 7660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:44.201359 7660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:44.206059 7660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39829
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:44.207154 7660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:44.208516 7660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:44.216930 7670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.217041 7660 server_base.cc:1034] running on GCE node
W20260809 15:44:44.216952 7674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:44.216934 7669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.217804 7660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:44.218945 7660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:44.220109 7660 hybrid_clock.cc:648] HybridClock initialized: now 1786290284220081 us; error 38 us; skew 500 ppm
I20260809 15:44:44.222009 7660 webserver.cc:460] Webserver started at http://127.14.15.190:43981/ using document root <none> and password file <none>
I20260809 15:44:44.222609 7660 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:44.222673 7660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:44.222839 7660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:44.224788 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "54ea3e56bec74f048c522d1f5b8581c5"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "eaeb343abb0af7f0d52fef127167830f"
server_key_iv: "58fc9fef6a65b5ac8e7d95fbac8cc866"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.225296 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "54ea3e56bec74f048c522d1f5b8581c5"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "eaeb343abb0af7f0d52fef127167830f"
server_key_iv: "58fc9fef6a65b5ac8e7d95fbac8cc866"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.228885 7660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:44:44.231299 7682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.232558 7660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:44.232684 7660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "54ea3e56bec74f048c522d1f5b8581c5"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "eaeb343abb0af7f0d52fef127167830f"
server_key_iv: "58fc9fef6a65b5ac8e7d95fbac8cc866"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.232779 7660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:44.244192 7660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:44.245028 7660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:44.245224 7660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:44.252204 7660 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39829
I20260809 15:44:44.252241 7755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39829 every 8 connection(s)
I20260809 15:44:44.253147 7660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:44.256371 7757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:44.261984 7757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: Bootstrap starting.
I20260809 15:44:44.262362 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7660
I20260809 15:44:44.262511 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:44.262815 14398 external_mini_cluster.cc:1428] Setting key c0c11e109120dddaff05c5385b4da925
I20260809 15:44:44.264885 7757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:44.265637 7757 log.cc:824] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:44.267737 7757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: No bootstrap required, opened a new log
I20260809 15:44:44.272183 7757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } }
I20260809 15:44:44.272383 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.264170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.14.15.190:39829)
0809 15:44:44.264829 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.264843 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.264878 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:44:44.265560 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.265576 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.266040 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.266453 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:44.266806 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.267759 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.268988 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.269472 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.269594 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.270513 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:44.270518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:44.270531 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:44.271002 (+ 471us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:44.271060 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:44.271082 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:44.271169 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.271382 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.271670 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":128,"threads_started":1}
I20260809 15:44:44.272426 7757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:44.272503 7757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54ea3e56bec74f048c522d1f5b8581c5, State: Initialized, Role: FOLLOWER
I20260809 15:44:44.273015 7757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } }
I20260809 15:44:44.273185 7757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:44.273247 7757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:44.273342 7757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:44.274305 7757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } }
I20260809 15:44:44.274675 7757 leader_election.cc:302] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54ea3e56bec74f048c522d1f5b8581c5; no voters:
I20260809 15:44:44.275030 7757 leader_election.cc:288] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:44.275147 7765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:44.275406 7765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [term 1 LEADER]: Becoming Leader. State: Replica: 54ea3e56bec74f048c522d1f5b8581c5, State: Running, Role: LEADER
I20260809 15:44:44.275763 7765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } }
I20260809 15:44:44.276276 7757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:44.277521 7768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54ea3e56bec74f048c522d1f5b8581c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } } }
I20260809 15:44:44.277524 7770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54ea3e56bec74f048c522d1f5b8581c5. Latest consensus state: current_term: 1 leader_uuid: "54ea3e56bec74f048c522d1f5b8581c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54ea3e56bec74f048c522d1f5b8581c5" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39829 } } }
I20260809 15:44:44.277691 7768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:44.277691 7770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:44.278141 7779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:44.281602 7779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:44.287966 7779 catalog_manager.cc:1347] Generated new cluster ID: ace2cf3596c54c16a2b9789e7c678200
I20260809 15:44:44.288040 7779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:44.302136 7779 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:44.303385 7779 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:44.309242 7779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: Generated new TSK 0
I20260809 15:44:44.310052 7779 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:44.318420 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--builtin_ntp_servers=127.14.15.148:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:44.434190 7794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:44.434471 7794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:44.434511 7794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:44.438755 7794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:44.438810 7794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:44.438864 7794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:44.443516 7794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:44.444531 7794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:44.445927 7794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:44.455440 7805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:44.455444 7801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:44.455425 7802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.455705 7794 server_base.cc:1034] running on GCE node
I20260809 15:44:44.456202 7794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:44.456847 7794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:44.458019 7794 hybrid_clock.cc:648] HybridClock initialized: now 1786290284457999 us; error 29 us; skew 500 ppm
I20260809 15:44:44.459925 7794 webserver.cc:460] Webserver started at http://127.14.15.129:41811/ using document root <none> and password file <none>
I20260809 15:44:44.460502 7794 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:44.460564 7794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:44.460830 7794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:44.462898 7794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "4f50afa06ec5416eac550b831cd3fba6"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "fc46f34137f3be69db4c503612c231b9"
server_key_iv: "968250ea5ced2a9cd9d244380f6410e8"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.463464 7794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "4f50afa06ec5416eac550b831cd3fba6"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "fc46f34137f3be69db4c503612c231b9"
server_key_iv: "968250ea5ced2a9cd9d244380f6410e8"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.467063 7794 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:44:44.469360 7813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.470548 7794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:44:44.470680 7794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "4f50afa06ec5416eac550b831cd3fba6"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "fc46f34137f3be69db4c503612c231b9"
server_key_iv: "968250ea5ced2a9cd9d244380f6410e8"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.470790 7794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:44.482518 7794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:44.483099 7794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:44.483282 7794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:44.483822 7794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:44.484707 7794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:44.484779 7794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.484848 7794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:44.484891 7794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.493649 7794 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:34311
I20260809 15:44:44.493696 7983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:34311 every 8 connection(s)
I20260809 15:44:44.494503 7794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:44.495779 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7794
I20260809 15:44:44.495904 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:44.496237 14398 external_mini_cluster.cc:1428] Setting key d66cd96b1dd99443f1667a1c38e81b93
I20260809 15:44:44.498441 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--builtin_ntp_servers=127.14.15.148:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:44.505669 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.496232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:56553 (local address 127.14.15.190:39829)
0809 15:44:44.496377 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.496382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.497616 (+ 1234us) server_negotiation.cc:407] Connection header received
0809 15:44:44.499639 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.499641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.499685 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.499748 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:44.500848 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.501721 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.503569 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.503793 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.503870 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.505197 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:44.505200 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:44.505202 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:44.505214 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:44.505233 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:44.505240 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:44.505298 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.505510 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.505561 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:44:44.506920 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.496703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39829 (local address 127.14.15.129:56553)
0809 15:44:44.497467 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.497526 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.499359 (+ 1833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.499944 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.499956 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.500061 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:44.500706 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.500721 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.501875 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.501881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.503415 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.503431 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.503952 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.503958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.504208 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.504881 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:44.504886 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:44.504945 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:44.505033 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:44.505331 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:44.505344 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:44.505352 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.505495 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.505824 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":148,"threads_started":1}
I20260809 15:44:44.508121 7984 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39829
I20260809 15:44:44.508356 7984 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:44.508848 7984 heartbeater.cc:511] Master 127.14.15.190:39829 requested a full tablet report, sending...
I20260809 15:44:44.510277 7705 ts_manager.cc:194] Registered new tserver with Master: 4f50afa06ec5416eac550b831cd3fba6 (127.14.15.129:34311)
I20260809 15:44:44.511365 7705 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.129:56553
W20260809 15:44:44.616366 7988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:44.616739 7988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:44.616797 7988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:44.620934 7988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:44.621017 7988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:44.621106 7988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:44.625979 7988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:44.627094 7988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:44.628497 7988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:44.638391 7995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.638450 7988 server_base.cc:1034] running on GCE node
W20260809 15:44:44.638468 7996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:44.638626 7998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.639144 7988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:44.639779 7988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:44.640969 7988 hybrid_clock.cc:648] HybridClock initialized: now 1786290284640948 us; error 46 us; skew 500 ppm
I20260809 15:44:44.642850 7988 webserver.cc:460] Webserver started at http://127.14.15.130:44345/ using document root <none> and password file <none>
I20260809 15:44:44.643422 7988 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:44.643518 7988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:44.643762 7988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:44.645776 7988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "cee6e10f3460486aa91880f19cc92f2e"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "7c31ed6d4ee3c5ae7257392e5c8cb159"
server_key_iv: "4f23f654256ae46d22e46e854ce9f7ca"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.646402 7988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "cee6e10f3460486aa91880f19cc92f2e"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "7c31ed6d4ee3c5ae7257392e5c8cb159"
server_key_iv: "4f23f654256ae46d22e46e854ce9f7ca"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.649998 7988 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:44.652535 8007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.653730 7988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:44.653824 7988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "cee6e10f3460486aa91880f19cc92f2e"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "7c31ed6d4ee3c5ae7257392e5c8cb159"
server_key_iv: "4f23f654256ae46d22e46e854ce9f7ca"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.653909 7988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:44.668403 7988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:44.669009 7988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:44.669157 7988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:44.669667 7988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:44.670629 7988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:44.670675 7988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.670717 7988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:44.670732 7988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.681241 7988 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:42203
I20260809 15:44:44.681270 8164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:42203 every 8 connection(s)
I20260809 15:44:44.682296 7988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:44.686941 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 7988
I20260809 15:44:44.687104 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:44.687445 14398 external_mini_cluster.cc:1428] Setting key 561bc74764c9ef84587d130476a69b73
I20260809 15:44:44.689983 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--builtin_ntp_servers=127.14.15.148:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:44.693790 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.684289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:54407 (local address 127.14.15.190:39829)
0809 15:44:44.684457 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.684460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.685625 (+ 1165us) server_negotiation.cc:407] Connection header received
0809 15:44:44.687420 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.687423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.687475 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.687602 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:44.688883 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.689636 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.691518 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.691757 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.691926 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.693224 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:44.693228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:44.693233 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:44.693252 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:44.693272 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:44.693280 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:44.693368 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.693562 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.693639 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:44:44.694767 8167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.684719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39829 (local address 127.14.15.130:54407)
0809 15:44:44.685437 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.685482 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.687140 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.687845 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.687856 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.687963 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:44.688694 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.688715 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.689778 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.689785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.691348 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.691365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.691987 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.691992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.692202 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.692916 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:44.692918 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:44.692962 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:44.693045 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:44.693370 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:44.693383 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:44.693390 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.693537 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.693863 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":122,"threads_started":1}
I20260809 15:44:44.696378 8165 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39829
I20260809 15:44:44.696696 8165 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:44.697449 8165 heartbeater.cc:511] Master 127.14.15.190:39829 requested a full tablet report, sending...
I20260809 15:44:44.698925 7705 ts_manager.cc:194] Registered new tserver with Master: cee6e10f3460486aa91880f19cc92f2e (127.14.15.130:42203)
I20260809 15:44:44.699848 7705 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.130:54407
W20260809 15:44:44.808202 8168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:44.808488 8168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:44.808530 8168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:44.812886 8168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:44.812963 8168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:44.813021 8168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:44.818347 8168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:39829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:44.819558 8168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:44.820988 8168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:44.831137 8180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:44.831156 8184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.831207 8168 server_base.cc:1034] running on GCE node
W20260809 15:44:44.831153 8182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:44.831807 8168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:44.832429 8168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:44.833596 8168 hybrid_clock.cc:648] HybridClock initialized: now 1786290284833579 us; error 30 us; skew 500 ppm
I20260809 15:44:44.835791 8168 webserver.cc:460] Webserver started at http://127.14.15.131:38761/ using document root <none> and password file <none>
I20260809 15:44:44.836467 8168 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:44.836539 8168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:44.836822 8168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:44.839069 8168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "ef54a213c55640f49155d1d7a4e6b688"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "bef2efefc60b93a6e34ec0fe0d495cdc"
server_key_iv: "6359f6f8cf7695e69679f0339b109646"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.839691 8168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "ef54a213c55640f49155d1d7a4e6b688"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "bef2efefc60b93a6e34ec0fe0d495cdc"
server_key_iv: "6359f6f8cf7695e69679f0339b109646"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.843415 8168 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:44:44.845866 8196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.847255 8168 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:44.847359 8168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "ef54a213c55640f49155d1d7a4e6b688"
format_stamp: "Formatted at 2026-08-09 15:44:44 on dist-test-slave-jztv"
server_key: "bef2efefc60b93a6e34ec0fe0d495cdc"
server_key_iv: "6359f6f8cf7695e69679f0339b109646"
server_key_version: "encryptionkey@0"
I20260809 15:44:44.847510 8168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:44.881248 8168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:44.881996 8168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:44.882239 8168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:44.882871 8168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:44.883842 8168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:44.883893 8168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.883963 8168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:44.883997 8168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:44.892491 8168 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:40761
I20260809 15:44:44.892526 8352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:40761 every 8 connection(s)
I20260809 15:44:44.893421 8168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:44.899274 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 8168
I20260809 15:44:44.899425 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:44.899699 14398 external_mini_cluster.cc:1428] Setting key 94d8c5c5ec21b98cc964ead4276376f6
I20260809 15:44:44.902849 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.895319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:51187 (local address 127.14.15.190:39829)
0809 15:44:44.895471 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.895476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.896529 (+ 1053us) server_negotiation.cc:407] Connection header received
0809 15:44:44.897963 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.897965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.898014 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.898103 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:44.898981 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.899623 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.900839 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.901073 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.901187 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.902342 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:44.902352 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:44.902355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:44.902367 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:44.902386 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:44.902394 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:44.902473 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.902642 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.902704 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:44:44.903676 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.895754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:39829 (local address 127.14.15.131:51187)
0809 15:44:44.896381 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.896420 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.897763 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.898282 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.898289 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.898370 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:44.898851 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.898863 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.899759 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.899762 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.900694 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.900705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.901231 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.901235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.901406 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.902058 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:44.902059 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:44.902099 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:44.902161 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:44.902491 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:44.902500 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:44.902508 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.902642 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.902929 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260809 15:44:44.904794 8353 heartbeater.cc:347] Connected to a master server at 127.14.15.190:39829
I20260809 15:44:44.905030 8353 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:44.905562 8353 heartbeater.cc:511] Master 127.14.15.190:39829 requested a full tablet report, sending...
I20260809 15:44:44.906616 7705 ts_manager.cc:194] Registered new tserver with Master: ef54a213c55640f49155d1d7a4e6b688 (127.14.15.131:40761)
I20260809 15:44:44.907140 7705 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.131:51187
I20260809 15:44:44.913381 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:44.919210 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.915411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46968 (local address 127.14.15.190:39829)
0809 15:44:44.915566 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.915570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.915748 (+ 178us) server_negotiation.cc:407] Connection header received
0809 15:44:44.915837 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.915839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.915880 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.915938 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:44.916170 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.916678 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.917514 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.917751 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.917844 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.918740 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:44.918744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:44.918746 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:44.918766 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:44.918786 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:44.918793 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:44.918866 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.918937 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.918996 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:44:44.922156 7705 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:44.925164 7705 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:44.939478 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.933280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34311 (local address 127.0.0.1:54312)
0809 15:44:44.933809 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.933858 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.933981 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.935492 (+ 1511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.935495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.935514 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:44.935617 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.935627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936840 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.936843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.938029 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.938039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.939048 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.939051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.939127 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.939158 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.939234 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.939317 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":147,"thread_start_us":78,"threads_started":1}
I20260809 15:44:44.939599 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.933454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54312 (local address 127.14.15.129:34311)
0809 15:44:44.934973 (+ 1519us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.934983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.935029 (+ 46us) server_negotiation.cc:407] Connection header received
0809 15:44:44.935104 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.935108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.935327 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.935506 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:44.935748 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936699 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.938166 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.938919 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.939031 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.939221 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.939275 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.939395 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1420,"thread_start_us":161,"threads_started":1}
I20260809 15:44:44.940671 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.933983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40761 (local address 127.0.0.1:60418)
0809 15:44:44.934686 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.934699 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.934780 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.935293 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.935299 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.935321 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:44.935417 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.935426 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936843 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.936846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.938472 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.938484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.939519 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.939525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.939636 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.939662 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.940457 (+ 795us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.940531 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":178,"thread_start_us":127,"threads_started":1}
I20260809 15:44:44.941259 8383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.934481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60418 (local address 127.14.15.131:40761)
0809 15:44:44.934840 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.934852 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.934875 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:44:44.934951 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.934956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.935142 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.935302 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:44.935568 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936706 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.938605 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.939382 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.939503 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.941017 (+ 1514us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.941059 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.941137 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":174,"threads_started":1}
I20260809 15:44:44.941953 8381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.933485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42203 (local address 127.0.0.1:39508)
0809 15:44:44.934254 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:44.934270 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:44.934358 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:44.935047 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:44.935053 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:44.935075 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:44.935222 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.935250 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936843 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.936846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.938472 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:44.938484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.941566 (+ 3082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.941570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:44.941666 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.941689 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:44:44.941770 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:44:44.941836 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":213,"thread_start_us":111,"threads_started":1}
I20260809 15:44:44.942044 8382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:44.934013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.14.15.130:42203)
0809 15:44:44.934512 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:44.934525 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:44.934564 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:44:44.934649 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:44.934654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:44.934873 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:44.935050 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:44.935384 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.936706 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.939891 (+ 3185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:44.940690 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:44.941540 (+ 850us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:44.941716 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:44.941797 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 15:44:44.941883 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":130,"threads_started":1}
I20260809 15:44:44.942757 7892 tablet_service.cc:1467] Processing CreateTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb (DEFAULT_TABLE table=test-table [id=11fbcc2d2dcb49728c45628c52e693c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:44.943852 7892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdf68dbe90ce4256b4a5728cf1a0cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:44.943970 8268 tablet_service.cc:1467] Processing CreateTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb (DEFAULT_TABLE table=test-table [id=11fbcc2d2dcb49728c45628c52e693c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:44.944977 8268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdf68dbe90ce4256b4a5728cf1a0cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:44.944981 8077 tablet_service.cc:1467] Processing CreateTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb (DEFAULT_TABLE table=test-table [id=11fbcc2d2dcb49728c45628c52e693c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:44.945953 8077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdf68dbe90ce4256b4a5728cf1a0cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:44.950508 8388 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Bootstrap starting.
I20260809 15:44:44.952962 8388 tablet_bootstrap.cc:654] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:44.953223 8392 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Bootstrap starting.
I20260809 15:44:44.953289 8390 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Bootstrap starting.
I20260809 15:44:44.953933 8388 log.cc:824] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:44.955272 8390 tablet_bootstrap.cc:654] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:44.955363 8392 tablet_bootstrap.cc:654] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:44.955973 8390 log.cc:824] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:44.956154 8388 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: No bootstrap required, opened a new log
I20260809 15:44:44.956177 8392 log.cc:824] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:44.956353 8388 ts_tablet_manager.cc:1397] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 15:44:44.958251 8390 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: No bootstrap required, opened a new log
I20260809 15:44:44.958453 8390 ts_tablet_manager.cc:1397] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:44.959501 8392 tablet_bootstrap.cc:492] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: No bootstrap required, opened a new log
I20260809 15:44:44.959730 8392 ts_tablet_manager.cc:1397] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:44:44.960937 8388 raft_consensus.cc:348] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.961228 8388 raft_consensus.cc:374] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:44.961280 8388 raft_consensus.cc:729] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f50afa06ec5416eac550b831cd3fba6, State: Initialized, Role: FOLLOWER
I20260809 15:44:44.961820 8388 consensus_queue.cc:260] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.962954 8388 ts_tablet_manager.cc:1428] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260809 15:44:44.963145 8390 raft_consensus.cc:348] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.963374 7984 heartbeater.cc:503] Master 127.14.15.190:39829 was elected leader, sending a full tablet report...
I20260809 15:44:44.963416 8390 raft_consensus.cc:374] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:44.963497 8390 raft_consensus.cc:729] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef54a213c55640f49155d1d7a4e6b688, State: Initialized, Role: FOLLOWER
I20260809 15:44:44.963582 8392 raft_consensus.cc:348] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.963843 8392 raft_consensus.cc:374] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:44.963903 8392 raft_consensus.cc:729] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6e10f3460486aa91880f19cc92f2e, State: Initialized, Role: FOLLOWER
I20260809 15:44:44.963946 8390 consensus_queue.cc:260] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.964340 8392 consensus_queue.cc:260] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:44.964979 8390 ts_tablet_manager.cc:1428] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:44.964999 8353 heartbeater.cc:503] Master 127.14.15.190:39829 was elected leader, sending a full tablet report...
I20260809 15:44:44.965318 8392 ts_tablet_manager.cc:1428] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:44.965667 8165 heartbeater.cc:503] Master 127.14.15.190:39829 was elected leader, sending a full tablet report...
W20260809 15:44:44.995584 7985 tablet.cc:2369] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:45.000203 8400 raft_consensus.cc:482] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:45.000428 8400 raft_consensus.cc:504] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:45.001600 8400 leader_election.cc:288] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f50afa06ec5416eac550b831cd3fba6 (127.14.15.129:34311), cee6e10f3460486aa91880f19cc92f2e (127.14.15.130:42203)
I20260809 15:44:45.005306 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.001840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34311 (local address 127.14.15.131:57393)
0809 15:44:45.002003 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:45.002020 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:45.002133 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:45.002468 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:45.002472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:45.002491 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:45.002619 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:45.002625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.003382 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.003386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:45.004184 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:45.004193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.004862 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.004865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:45.004966 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:45.004989 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:44:45.005098 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:44:45.005174 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 15:44:45.005306 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.002057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:57393 (local address 127.14.15.129:34311)
0809 15:44:45.002240 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:45.002247 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:45.002260 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:44:45.002318 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:45.002320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:45.002361 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:45.002452 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:45.002740 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.003262 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.004320 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.004731 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.004865 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:45.004917 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:45.005108 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 15:44:45.005182 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:44:45.005470 8382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.001952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:35255 (local address 127.14.15.130:42203)
0809 15:44:45.002081 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:45.002086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:45.002398 (+ 312us) server_negotiation.cc:407] Connection header received
0809 15:44:45.002559 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:45.002562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:45.002617 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:45.002705 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:45.002977 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.003464 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.004500 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.004896 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.005033 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:45.005083 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:45.005286 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 15:44:45.005360 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:44:45.005498 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.001840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:42203 (local address 127.14.15.131:35255)
0809 15:44:45.002284 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:45.002296 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:45.002431 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:45.002719 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:45.002722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:45.002738 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:45.002859 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:45.002865 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.003598 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.003602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:45.004364 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:45.004373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.005048 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.005051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:45.005158 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:45.005177 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 15:44:45.005266 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:44:45.005335 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":128,"thread_start_us":111,"threads_started":1}
I20260809 15:44:45.006091 8106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdf68dbe90ce4256b4a5728cf1a0cacb" candidate_uuid: "ef54a213c55640f49155d1d7a4e6b688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6e10f3460486aa91880f19cc92f2e" is_pre_election: true
I20260809 15:44:45.006098 7920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdf68dbe90ce4256b4a5728cf1a0cacb" candidate_uuid: "ef54a213c55640f49155d1d7a4e6b688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f50afa06ec5416eac550b831cd3fba6" is_pre_election: true
I20260809 15:44:45.006418 8106 raft_consensus.cc:2454] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef54a213c55640f49155d1d7a4e6b688 in term 0.
I20260809 15:44:45.006430 7920 raft_consensus.cc:2454] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef54a213c55640f49155d1d7a4e6b688 in term 0.
I20260809 15:44:45.006902 8204 leader_election.cc:302] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f50afa06ec5416eac550b831cd3fba6, ef54a213c55640f49155d1d7a4e6b688; no voters:
I20260809 15:44:45.007200 8400 raft_consensus.cc:2781] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:45.007292 8400 raft_consensus.cc:482] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:45.007336 8400 raft_consensus.cc:3037] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:45.008402 8400 raft_consensus.cc:504] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:45.008819 8400 leader_election.cc:288] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [CANDIDATE]: Term 1 election: Requested vote from peers 4f50afa06ec5416eac550b831cd3fba6 (127.14.15.129:34311), cee6e10f3460486aa91880f19cc92f2e (127.14.15.130:42203)
I20260809 15:44:45.009173 7920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdf68dbe90ce4256b4a5728cf1a0cacb" candidate_uuid: "ef54a213c55640f49155d1d7a4e6b688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f50afa06ec5416eac550b831cd3fba6"
I20260809 15:44:45.009207 8106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdf68dbe90ce4256b4a5728cf1a0cacb" candidate_uuid: "ef54a213c55640f49155d1d7a4e6b688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6e10f3460486aa91880f19cc92f2e"
I20260809 15:44:45.009333 8106 raft_consensus.cc:3037] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:45.009327 7920 raft_consensus.cc:3037] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:45.010547 8106 raft_consensus.cc:2454] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef54a213c55640f49155d1d7a4e6b688 in term 1.
I20260809 15:44:45.010637 7920 raft_consensus.cc:2454] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef54a213c55640f49155d1d7a4e6b688 in term 1.
I20260809 15:44:45.010921 8206 leader_election.cc:302] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cee6e10f3460486aa91880f19cc92f2e, ef54a213c55640f49155d1d7a4e6b688; no voters:
I20260809 15:44:45.011137 8400 raft_consensus.cc:2781] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:45.011386 8400 raft_consensus.cc:686] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 1 LEADER]: Becoming Leader. State: Replica: ef54a213c55640f49155d1d7a4e6b688, State: Running, Role: LEADER
I20260809 15:44:45.011724 8400 consensus_queue.cc:237] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } }
I20260809 15:44:45.014922 7705 catalog_manager.cc:5495] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef54a213c55640f49155d1d7a4e6b688 (127.14.15.131). New cstate: current_term: 1 leader_uuid: "ef54a213c55640f49155d1d7a4e6b688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef54a213c55640f49155d1d7a4e6b688" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260809 15:44:45.037657 8383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.033680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.14.15.131:40761)
0809 15:44:45.033818 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:45.033821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:45.033835 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:44:45.033906 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:45.033908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:45.033962 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:45.034052 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:45.034479 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.035048 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.036041 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:45.036283 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:45.036417 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:45.036676 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:45.037169 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:45.037265 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:45.037383 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 15:44:45.037433 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:44:45.043635 7920 raft_consensus.cc:1261] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 1 FOLLOWER]: Refusing update from remote peer ef54a213c55640f49155d1d7a4e6b688: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:45.043635 8106 raft_consensus.cc:1261] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 1 FOLLOWER]: Refusing update from remote peer ef54a213c55640f49155d1d7a4e6b688: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:45.044409 8407 consensus_queue.cc:1035] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cee6e10f3460486aa91880f19cc92f2e" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 42203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:45.044559 8400 consensus_queue.cc:1035] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f50afa06ec5416eac550b831cd3fba6" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:45.052510 8413 mvcc.cc:205] Tried to move back new op lower bound from 7316645007530962944 to 7316645007410671616. Current Snapshot: MvccSnapshot[applied={T|T < 7316645007530962944}]
I20260809 15:44:45.053648 8414 mvcc.cc:205] Tried to move back new op lower bound from 7316645007530962944 to 7316645007410671616. Current Snapshot: MvccSnapshot[applied={T|T < 7316645007530962944}]
I20260809 15:44:45.063958 7704 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:45.064155 7704 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:45.066583 7704 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54ea3e56bec74f048c522d1f5b8581c5: Sending DeleteTablet for 3 replicas of tablet cdf68dbe90ce4256b4a5728cf1a0cacb
I20260809 15:44:45.067375 8077 tablet_service.cc:1514] Processing DeleteTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:45 UTC) from {username='slave'} at 127.0.0.1:39508
I20260809 15:44:45.067406 7892 tablet_service.cc:1514] Processing DeleteTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:45 UTC) from {username='slave'} at 127.0.0.1:54312
I20260809 15:44:45.068060 8268 tablet_service.cc:1514] Processing DeleteTablet for tablet cdf68dbe90ce4256b4a5728cf1a0cacb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:45 UTC) from {username='slave'} at 127.0.0.1:60418
I20260809 15:44:45.068127 8428 tablet_replica.cc:330] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6: stopping tablet replica
I20260809 15:44:45.068250 8427 tablet_replica.cc:330] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: stopping tablet replica
I20260809 15:44:45.068455 8428 raft_consensus.cc:2229] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:45.068678 8427 raft_consensus.cc:2229] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:45.068804 8428 raft_consensus.cc:2258] T cdf68dbe90ce4256b4a5728cf1a0cacb P 4f50afa06ec5416eac550b831cd3fba6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:45.068939 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7794
I20260809 15:44:45.069121 8427 raft_consensus.cc:2258] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:45.073581 8427 ts_tablet_manager.cc:1905] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:45.076630 8427 ts_tablet_manager.cc:1918] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:45.076812 8427 log.cc:1196] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/cdf68dbe90ce4256b4a5728cf1a0cacb
I20260809 15:44:45.077131 8427 ts_tablet_manager.cc:1939] T cdf68dbe90ce4256b4a5728cf1a0cacb P cee6e10f3460486aa91880f19cc92f2e: Deleting consensus metadata
I20260809 15:44:45.078517 8429 tablet_replica.cc:330] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: stopping tablet replica
I20260809 15:44:45.078624 7687 catalog_manager.cc:4841] TS cee6e10f3460486aa91880f19cc92f2e (127.14.15.130:42203): tablet cdf68dbe90ce4256b4a5728cf1a0cacb (table test-table [id=11fbcc2d2dcb49728c45628c52e693c0]) successfully deleted
I20260809 15:44:45.079063 8429 raft_consensus.cc:2229] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:45.079552 8429 raft_consensus.cc:2258] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:45.081245 8429 ts_tablet_manager.cc:1905] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 15:44:45.081506 7686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:34311 (error 108)
I20260809 15:44:45.082660 8381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:45.082343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:34311 (local address 127.0.0.1:54328)
0809 15:44:45.082484 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:45.082559 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 15:44:45.082759 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7988
I20260809 15:44:45.086426 8429 ts_tablet_manager.cc:1918] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:45.086573 8429 log.cc:1196] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/cdf68dbe90ce4256b4a5728cf1a0cacb
I20260809 15:44:45.086968 8429 ts_tablet_manager.cc:1939] T cdf68dbe90ce4256b4a5728cf1a0cacb P ef54a213c55640f49155d1d7a4e6b688: Deleting consensus metadata
I20260809 15:44:45.088343 7684 catalog_manager.cc:4841] TS ef54a213c55640f49155d1d7a4e6b688 (127.14.15.131:40761): tablet cdf68dbe90ce4256b4a5728cf1a0cacb (table test-table [id=11fbcc2d2dcb49728c45628c52e693c0]) successfully deleted
W20260809 15:44:45.088719 7686 catalog_manager.cc:4584] TS 4f50afa06ec5416eac550b831cd3fba6 (127.14.15.129:34311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cdf68dbe90ce4256b4a5728cf1a0cacb: Network error: Client connection negotiation failed: client connection to 127.14.15.129:34311: connect: Connection refused (error 111)
I20260809 15:44:45.095021 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 8168
I20260809 15:44:45.106766 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 7660
2026-08-09T15:44:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1057 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:45 dist-test-slave-jztv krb5kdc[8433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:45 dist-test-slave-jztv krb5kdc[8433](info): set up 2 sockets
Aug 09 15:44:45 dist-test-slave-jztv krb5kdc[8433](info): commencing operation
krb5kdc: starting...
W20260809 15:44:46.357188 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:46 dist-test-slave-jztv krb5kdc[8433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:44:46.489620 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34723
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:34723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:46.608682 8449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:46.608979 8449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:46.609022 8449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:46.613108 8449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:46.613174 8449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:46.613194 8449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:46.613211 8449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:46.613273 8449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:46.618860 8449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:34723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:34723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:46.620074 8449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:46.621186 8449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:46.630313 8459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:46.630338 8458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:46.630309 8462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:46.630370 8449 server_base.cc:1034] running on GCE node
I20260809 15:44:46.631192 8449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:46.632335 8449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:46.633522 8449 hybrid_clock.cc:648] HybridClock initialized: now 1786290286633493 us; error 40 us; skew 500 ppm
Aug 09 15:44:46 dist-test-slave-jztv krb5kdc[8433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:46.636418 8449 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:44:46.637451 8449 webserver.cc:460] Webserver started at http://127.14.15.190:34277/ using document root <none> and password file <none>
I20260809 15:44:46.638069 8449 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:46.638163 8449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:46.638448 8449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:46.640626 8449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "ba8842f8a02c499c9561f1f19b0499c8"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "d2745c507c752299bbb9a1eb34303a78"
server_key_iv: "2d1b95f9303b75bbd327fb9b12349bdf"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.641232 8449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "ba8842f8a02c499c9561f1f19b0499c8"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "d2745c507c752299bbb9a1eb34303a78"
server_key_iv: "2d1b95f9303b75bbd327fb9b12349bdf"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.645270 8449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:44:46.648245 8472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:46.649492 8449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:46.649667 8449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "ba8842f8a02c499c9561f1f19b0499c8"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "d2745c507c752299bbb9a1eb34303a78"
server_key_iv: "2d1b95f9303b75bbd327fb9b12349bdf"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.649798 8449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:46.663806 8449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:46.667189 8449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:46.667409 8449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:46.675414 8449 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:34723
I20260809 15:44:46.675437 8550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:34723 every 8 connection(s)
I20260809 15:44:46.676627 8449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:46.677313 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 8449
I20260809 15:44:46.677489 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:46.677835 14398 external_mini_cluster.cc:1428] Setting key f85e767a565f08b391938bc11e1a1052
I20260809 15:44:46.680215 8551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:46.687433 8551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: Bootstrap starting.
Aug 09 15:44:46 dist-test-slave-jztv krb5kdc[8433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:46.690358 8551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:46.691284 8551 log.cc:824] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:46.693375 8551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: No bootstrap required, opened a new log
I20260809 15:44:46.693639 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:46.679436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.14.15.190:34723)
0809 15:44:46.679932 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:46.679951 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:46.679995 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:44:46.680867 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:46.680890 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:46.681316 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:46.681686 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:46.682556 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.684096 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.685029 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.685742 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.685915 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:46.688770 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:46.688775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:46.688788 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:46.688817 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:46.690713 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:46.691227 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:46.691232 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:46.691236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:46.691346 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:46.691681 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:46.691687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:46.691690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:46.692087 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:46.692318 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:46.692575 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 15:44:46.692877 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":138,"threads_started":1}
I20260809 15:44:46.697139 8551 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } }
I20260809 15:44:46.697371 8551 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:46.697405 8551 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8842f8a02c499c9561f1f19b0499c8, State: Initialized, Role: FOLLOWER
I20260809 15:44:46.697852 8551 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } }
I20260809 15:44:46.698012 8551 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:46.698086 8551 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:46.698163 8551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:46.699152 8551 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } }
I20260809 15:44:46.699537 8551 leader_election.cc:302] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba8842f8a02c499c9561f1f19b0499c8; no voters:
I20260809 15:44:46.699905 8551 leader_election.cc:288] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:46.699996 8559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:46.700217 8559 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [term 1 LEADER]: Becoming Leader. State: Replica: ba8842f8a02c499c9561f1f19b0499c8, State: Running, Role: LEADER
I20260809 15:44:46.700533 8559 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } }
I20260809 15:44:46.701232 8551 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:46.704691 8562 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba8842f8a02c499c9561f1f19b0499c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } } }
I20260809 15:44:46.704818 8562 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:46.705081 8563 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba8842f8a02c499c9561f1f19b0499c8. Latest consensus state: current_term: 1 leader_uuid: "ba8842f8a02c499c9561f1f19b0499c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8842f8a02c499c9561f1f19b0499c8" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 34723 } } }
I20260809 15:44:46.705154 8563 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8 [sys.catalog]: This master's current role is: LEADER
W20260809 15:44:46.708207 8588 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:44:46.708411 8588 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:44:46.710826 8589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:46.711892 8589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:46.718302 8589 catalog_manager.cc:1347] Generated new cluster ID: 96969b9e022b4b9387f5d9a64713283d
I20260809 15:44:46.718379 8589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:46.730480 8589 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:46.731458 8589 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:46.738853 8589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: Generated new TSK 0
I20260809 15:44:46.739566 8589 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:44:46.779048 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:46.893635 8597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:46.893880 8597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:46.893923 8597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:46.897898 8597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:46.897955 8597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:46.898012 8597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:46.903251 8597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:46.904312 8597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:46.905331 8597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:46.914880 8605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:46.914901 8603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:46.914901 8602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:46.915629 8597 server_base.cc:1034] running on GCE node
I20260809 15:44:46.916023 8597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:46.916654 8597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:46.917822 8597 hybrid_clock.cc:648] HybridClock initialized: now 1786290286917806 us; error 26 us; skew 500 ppm
Aug 09 15:44:46 dist-test-slave-jztv krb5kdc[8433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:46.921272 8597 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:44:46.922108 8597 webserver.cc:460] Webserver started at http://127.14.15.129:34717/ using document root <none> and password file <none>
I20260809 15:44:46.922708 8597 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:46.922775 8597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:46.922945 8597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:46.924919 8597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "c021f970b8224c4689f8a0938a2bf1da"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "3e8ef7ecf8df3174b88f8842ef556bfb"
server_key_iv: "4ddb9fabee72753976eab02e32e3e2b2"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.925413 8597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "c021f970b8224c4689f8a0938a2bf1da"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "3e8ef7ecf8df3174b88f8842ef556bfb"
server_key_iv: "4ddb9fabee72753976eab02e32e3e2b2"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.929121 8597 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 15:44:46.931552 8617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:46.932753 8597 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:44:46.932876 8597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "c021f970b8224c4689f8a0938a2bf1da"
format_stamp: "Formatted at 2026-08-09 15:44:46 on dist-test-slave-jztv"
server_key: "3e8ef7ecf8df3174b88f8842ef556bfb"
server_key_iv: "4ddb9fabee72753976eab02e32e3e2b2"
server_key_version: "encryptionkey@0"
I20260809 15:44:46.932982 8597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:46.956578 8597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:46.959937 8597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:46.960147 8597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:46.960777 8597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:46.961711 8597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:46.961760 8597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:46.961825 8597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:46.961856 8597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:46.971158 8597 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:36389
I20260809 15:44:46.971187 8793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:36389 every 8 connection(s)
I20260809 15:44:46.972052 8597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:46.976848 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 8597
I20260809 15:44:46.977020 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:46.977355 14398 external_mini_cluster.cc:1428] Setting key 14a4ddc6d2f51b5e92a5a268c57f41d1
Aug 09 15:44:46 dist-test-slave-jztv krb5kdc[8433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:46.987465 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:46.974132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:54205 (local address 127.14.15.190:34723)
0809 15:44:46.974312 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:46.974317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:46.976096 (+ 1779us) server_negotiation.cc:407] Connection header received
0809 15:44:46.977732 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:46.977736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:46.977807 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:46.977894 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:46.979177 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.979743 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.980904 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.981155 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.981274 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:46.983791 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:46.983795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:46.983798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:46.983833 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:46.985293 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:46.985841 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:46.985845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:46.985847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:46.985930 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:46.986312 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:46.986316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:46.986317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:46.986502 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:46.986621 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:46.987144 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 15:44:46.987285 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
I20260809 15:44:46.988294 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:46.974707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34723 (local address 127.14.15.129:54205)
0809 15:44:46.975935 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:46.975977 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:46.977519 (+ 1542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:46.978094 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:46.978101 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:46.978535 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:46.979021 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:46.979042 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.979879 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.979882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:46.980771 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:46.980781 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:46.981316 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:46.981320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:46.981488 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:46.982113 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:46.982130 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:46.983623 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:46.985435 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:46.985441 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:46.985458 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:46.985730 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:46.986028 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:46.986032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:46.986040 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:46.986186 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:46.986621 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:46.986629 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:46.986891 (+ 262us) client_negotiation.cc:769] Sending connection context
0809 15:44:46.987086 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 15:44:46.987423 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"thread_start_us":157,"threads_started":1}
I20260809 15:44:46.989717 8795 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34723
I20260809 15:44:46.990010 8795 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:46.990717 8795 heartbeater.cc:511] Master 127.14.15.190:34723 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
I20260809 15:44:46.992574 8496 ts_manager.cc:194] Registered new tserver with Master: c021f970b8224c4689f8a0938a2bf1da (127.14.15.129:36389)
I20260809 15:44:46.994069 8496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:54205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:44:47.008953 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:47.137869 8801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:47.138209 8801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:47.138329 8801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:47.144246 8801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:47.144321 8801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:47.144428 8801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:47.150980 8801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:47.152420 8801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:47.153662 8801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:47.164733 8811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:47.164727 8808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:47.164727 8807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:47.164795 8801 server_base.cc:1034] running on GCE node
I20260809 15:44:47.165468 8801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:47.166188 8801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:47.167483 8801 hybrid_clock.cc:648] HybridClock initialized: now 1786290287167472 us; error 32 us; skew 500 ppm
Aug 09 15:44:47 dist-test-slave-jztv krb5kdc[8433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:47.170565 8801 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:44:47.171483 8801 webserver.cc:460] Webserver started at http://127.14.15.130:36983/ using document root <none> and password file <none>
I20260809 15:44:47.172083 8801 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:47.172147 8801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:47.172374 8801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:47.174564 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "82486a931d34404b977485371607d713"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "aee10c095f8dd0f8b986dd194a536de8"
server_key_iv: "c86b07f2b08f35316e706eec394159ed"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.175149 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "82486a931d34404b977485371607d713"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "aee10c095f8dd0f8b986dd194a536de8"
server_key_iv: "c86b07f2b08f35316e706eec394159ed"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.178990 8801 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:44:47.181326 8822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.182564 8801 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:47.182686 8801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "82486a931d34404b977485371607d713"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "aee10c095f8dd0f8b986dd194a536de8"
server_key_iv: "c86b07f2b08f35316e706eec394159ed"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.182797 8801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:47.196120 8801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:47.199535 8801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:47.199750 8801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:47.200353 8801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:47.201269 8801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:47.201319 8801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.201385 8801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:47.201418 8801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.211072 8801 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:34483
I20260809 15:44:47.211105 8984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:34483 every 8 connection(s)
I20260809 15:44:47.211987 8801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:47.218348 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 8801
I20260809 15:44:47.218490 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:47.218794 14398 external_mini_cluster.cc:1428] Setting key 84cb262375a7fad293acf733607947c2
Aug 09 15:44:47 dist-test-slave-jztv krb5kdc[8433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:47.226321 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.213744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:59029 (local address 127.14.15.190:34723)
0809 15:44:47.213912 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.213925 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.214768 (+ 843us) server_negotiation.cc:407] Connection header received
0809 15:44:47.216058 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.216061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.216108 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.216185 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:47.217287 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.217838 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.219456 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.219684 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.219866 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.222419 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:47.222423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:47.222426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:47.222458 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:47.223947 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.224584 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.224587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.224588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.224669 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.225065 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.225068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.225069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.225235 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:47.225308 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.225975 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.226130 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":67}
I20260809 15:44:47.227437 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.214122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34723 (local address 127.14.15.130:59029)
0809 15:44:47.214617 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.214660 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.215860 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.216341 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.216347 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.216692 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:47.217152 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.217164 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.217956 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.217959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.219312 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.219325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.219855 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.219860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.220098 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.220749 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:47.220766 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:47.222197 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:47.224076 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:47.224084 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:47.224103 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:47.224464 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:47.224765 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:47.224771 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:47.224776 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:47.224963 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:47.225341 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:47.225350 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:47.225689 (+ 339us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.225923 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.226333 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":116,"threads_started":1}
I20260809 15:44:47.228672 8985 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34723
I20260809 15:44:47.228914 8985 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:47.229386 8985 heartbeater.cc:511] Master 127.14.15.190:34723 requested a full tablet report, sending...
I20260809 15:44:47.230480 8496 ts_manager.cc:194] Registered new tserver with Master: 82486a931d34404b977485371607d713 (127.14.15.130:34483)
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:44:47.231084 8496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:59029
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:44:47.249341 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:47.362462 8992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:47.362751 8992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:47.362835 8992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:47.366842 8992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:47.366932 8992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:47.367022 8992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:47.372264 8992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:47.373370 8992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:47.374447 8992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:47.384343 9008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:47.384349 9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:47.384579 8992 server_base.cc:1034] running on GCE node
W20260809 15:44:47.384361 9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:47.385066 8992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:47.385730 8992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:47.386893 8992 hybrid_clock.cc:648] HybridClock initialized: now 1786290287386878 us; error 25 us; skew 500 ppm
Aug 09 15:44:47 dist-test-slave-jztv krb5kdc[8433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:47.389719 8992 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:44:47.390663 8992 webserver.cc:460] Webserver started at http://127.14.15.131:43357/ using document root <none> and password file <none>
I20260809 15:44:47.391181 8992 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:47.391239 8992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:47.391405 8992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:47.393355 8992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "90cb719b9a18411d9a9d69e4b331a821"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "df41661cc1d8081815dc787f83b91283"
server_key_iv: "b83c2ce5f8b9b7ae348eb53cb0401e07"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.393877 8992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "90cb719b9a18411d9a9d69e4b331a821"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "df41661cc1d8081815dc787f83b91283"
server_key_iv: "b83c2ce5f8b9b7ae348eb53cb0401e07"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.397498 8992 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:44:47.399878 9017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.401055 8992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:44:47.401204 8992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "90cb719b9a18411d9a9d69e4b331a821"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "df41661cc1d8081815dc787f83b91283"
server_key_iv: "b83c2ce5f8b9b7ae348eb53cb0401e07"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.401321 8992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:47.446939 8992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:47.450476 8992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:47.450693 8992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:47.451326 8992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:47.452210 8992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:47.452289 8992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.452368 8992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:47.452419 8992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.461438 8992 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:42737
I20260809 15:44:47.461483 9191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:42737 every 8 connection(s)
I20260809 15:44:47.462487 8992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:47.466563 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 8992
I20260809 15:44:47.466698 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:47.466971 14398 external_mini_cluster.cc:1428] Setting key f56b4c36ebf222323ff65255a99338a9
Aug 09 15:44:47 dist-test-slave-jztv krb5kdc[8433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:47.476565 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.464369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:52455 (local address 127.14.15.190:34723)
0809 15:44:47.464543 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.464547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.465269 (+ 722us) server_negotiation.cc:407] Connection header received
0809 15:44:47.466796 (+ 1527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.466801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.466862 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.466983 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:47.468413 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.469032 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.470227 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.470463 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.470583 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.473013 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:47.473017 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:47.473019 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:47.473050 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:47.474484 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.475013 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.475017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.475018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.475104 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.475456 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.475461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.475466 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.475656 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:47.475770 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.476267 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.476396 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 15:44:47.477384 9196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.464670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:34723 (local address 127.14.15.131:52455)
0809 15:44:47.465101 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.465143 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.466550 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.467163 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.467170 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.467632 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:47.468270 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.468288 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.469159 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.469162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.470074 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.470084 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.470623 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.470628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.470813 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.471368 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:47.471385 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:47.472835 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:47.474605 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:47.474611 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:47.474627 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:47.474895 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:47.475209 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:47.475212 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:47.475214 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:47.475357 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:47.475769 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:47.475776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:47.476031 (+ 255us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.476224 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.476570 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":107,"threads_started":1}
I20260809 15:44:47.478655 9193 heartbeater.cc:347] Connected to a master server at 127.14.15.190:34723
I20260809 15:44:47.478919 9193 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:47.479461 9193 heartbeater.cc:511] Master 127.14.15.190:34723 requested a full tablet report, sending...
I20260809 15:44:47.480613 8496 ts_manager.cc:194] Registered new tserver with Master: 90cb719b9a18411d9a9d69e4b331a821 (127.14.15.131:42737)
I20260809 15:44:47.481104 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:47.481292 8496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:52455
I20260809 15:44:47.490862 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.483380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60830 (local address 127.14.15.190:34723)
0809 15:44:47.483526 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.483530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.483739 (+ 209us) server_negotiation.cc:407] Connection header received
0809 15:44:47.483820 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.483823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.483859 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.483922 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:47.484596 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.485083 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.485976 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.486177 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.486320 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.487918 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:47.487921 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:47.487923 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:47.487945 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:47.489191 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.489639 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.489642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.489643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.489715 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:47.489986 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:47.489988 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:47.489989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:47.490172 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:47.490360 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.490582 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.490689 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:44:47.493782 8496 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:47.496803 8496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:47.511901 9213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.505904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55986 (local address 127.14.15.129:36389)
0809 15:44:47.506971 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.506995 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.507023 (+ 28us) server_negotiation.cc:407] Connection header received
0809 15:44:47.507104 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.507110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.507334 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.507543 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:47.507882 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.508906 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.510443 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.511197 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.511329 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.511502 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.511653 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.511750 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":968,"thread_start_us":147,"threads_started":1}
I20260809 15:44:47.511888 9211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.505786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:36389 (local address 127.0.0.1:55986)
0809 15:44:47.506500 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.506540 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.506671 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.507528 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.507534 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.507559 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:47.507728 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.507738 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.509036 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.509039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.510273 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.510284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.511330 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.511334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.511440 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.511479 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.511601 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.511732 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":77,"threads_started":1}
I20260809 15:44:47.512873 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.506938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34483 (local address 127.0.0.1:33526)
0809 15:44:47.507790 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.507806 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.507896 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.508372 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.508375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.508395 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:47.508484 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.508489 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.509820 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.509823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.511002 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.511013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.512275 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.512279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.512482 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.512523 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.512600 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.512701 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":71,"thread_start_us":139,"threads_started":1}
I20260809 15:44:47.512910 9217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.507112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.14.15.130:34483)
0809 15:44:47.507938 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.507950 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.507973 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:44:47.508050 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.508054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.508215 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.508366 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:47.508608 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.509671 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.511158 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.511950 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.512074 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.512208 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.512664 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.512766 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":122,"threads_started":1}
I20260809 15:44:47.512872 9215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.505852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:42737 (local address 127.0.0.1:40342)
0809 15:44:47.507210 (+ 1358us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.507224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.507323 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.508000 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.508003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.508018 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:47.508093 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.508099 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.509564 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.509568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.510775 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.510785 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.512275 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.512279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.512478 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.512526 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.512598 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.512701 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"mutex_wait_us":121,"thread_start_us":112,"threads_started":1}
I20260809 15:44:47.513402 9214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.506492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40342 (local address 127.14.15.131:42737)
0809 15:44:47.506861 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.506873 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.507421 (+ 548us) server_negotiation.cc:407] Connection header received
0809 15:44:47.507507 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.507513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.507705 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.507858 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:47.508212 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.509416 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.510905 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.511985 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.512080 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.512208 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.512948 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.513079 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260809 15:44:47.515475 8693 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 (DEFAULT_TABLE table=test-table [id=db05dc00c1284e91b999991ba1f2dd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:47.516484 8693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca8cbb2568492a93739a3e5d1e72a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:47.516330 9097 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 (DEFAULT_TABLE table=test-table [id=db05dc00c1284e91b999991ba1f2dd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:47.516705 8887 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 (DEFAULT_TABLE table=test-table [id=db05dc00c1284e91b999991ba1f2dd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:47.517418 9097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca8cbb2568492a93739a3e5d1e72a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:47.517657 8887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca8cbb2568492a93739a3e5d1e72a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:47.523273 9218 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: Bootstrap starting.
I20260809 15:44:47.524570 9220 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Bootstrap starting.
I20260809 15:44:47.525002 9219 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Bootstrap starting.
I20260809 15:44:47.525813 9218 tablet_bootstrap.cc:654] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:47.526814 9218 log.cc:824] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:47.527407 9219 tablet_bootstrap.cc:654] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:47.528246 9220 tablet_bootstrap.cc:654] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:47.528782 9219 log.cc:824] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:47.529258 9218 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: No bootstrap required, opened a new log
I20260809 15:44:47.529466 9218 ts_tablet_manager.cc:1397] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:44:47.529573 9220 log.cc:824] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:47.530929 9219 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: No bootstrap required, opened a new log
I20260809 15:44:47.531126 9219 ts_tablet_manager.cc:1397] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:44:47.531363 9220 tablet_bootstrap.cc:492] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: No bootstrap required, opened a new log
I20260809 15:44:47.531560 9220 ts_tablet_manager.cc:1397] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:44:47.534154 9218 raft_consensus.cc:348] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.534505 9218 raft_consensus.cc:374] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:47.534344 9220 raft_consensus.cc:348] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.534585 9220 raft_consensus.cc:374] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:47.534603 9218 raft_consensus.cc:729] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021f970b8224c4689f8a0938a2bf1da, State: Initialized, Role: FOLLOWER
I20260809 15:44:47.534680 9220 raft_consensus.cc:729] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cb719b9a18411d9a9d69e4b331a821, State: Initialized, Role: FOLLOWER
I20260809 15:44:47.535104 9218 consensus_queue.cc:260] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.535125 9220 consensus_queue.cc:260] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.535101 9219 raft_consensus.cc:348] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.535356 9219 raft_consensus.cc:374] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:47.535465 9219 raft_consensus.cc:729] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82486a931d34404b977485371607d713, State: Initialized, Role: FOLLOWER
I20260809 15:44:47.535964 9219 consensus_queue.cc:260] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.536190 9220 ts_tablet_manager.cc:1428] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:47.536285 9218 ts_tablet_manager.cc:1428] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260809 15:44:47.536586 9193 heartbeater.cc:503] Master 127.14.15.190:34723 was elected leader, sending a full tablet report...
I20260809 15:44:47.536613 8795 heartbeater.cc:503] Master 127.14.15.190:34723 was elected leader, sending a full tablet report...
I20260809 15:44:47.536927 8985 heartbeater.cc:503] Master 127.14.15.190:34723 was elected leader, sending a full tablet report...
I20260809 15:44:47.536906 9219 ts_tablet_manager.cc:1428] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:47.652714 9227 raft_consensus.cc:482] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:47.653013 9227 raft_consensus.cc:504] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.654305 9227 leader_election.cc:288] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c021f970b8224c4689f8a0938a2bf1da (127.14.15.129:36389), 82486a931d34404b977485371607d713 (127.14.15.130:34483)
I20260809 15:44:47.658149 9196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.654547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:34483 (local address 127.14.15.131:59299)
0809 15:44:47.654698 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.654715 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.654816 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.655115 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.655118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.655161 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:47.655288 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.655293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.656030 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.656036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.657057 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.657067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.657705 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.657709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.657810 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.657837 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.657907 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.657982 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":1,"spinlock_wait_cycles":24192}
I20260809 15:44:47.658546 9231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.654555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:36389 (local address 127.14.15.131:36183)
0809 15:44:47.655029 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.655041 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:47.655176 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:47.655452 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:47.655455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:47.655471 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:47.655613 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.655619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.656342 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.656348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.657330 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:47.657340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.658120 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.658124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:47.658207 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.658276 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 15:44:47.658352 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:44:47.658419 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"mutex_wait_us":130,"spinlock_wait_cycles":2304,"thread_start_us":144,"threads_started":1}
I20260809 15:44:47.658591 9213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.654721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:36183 (local address 127.14.15.129:36389)
0809 15:44:47.654846 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.654851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.655130 (+ 279us) server_negotiation.cc:407] Connection header received
0809 15:44:47.655310 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.655312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.655354 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.655442 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:47.655736 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.656224 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.657459 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.657893 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.658009 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.658086 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.658379 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.658473 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:44:47.658676 9217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.654715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:59299 (local address 127.14.15.130:34483)
0809 15:44:47.654846 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.654851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.654868 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:44:47.654941 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.654943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.654988 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.655101 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:47.655410 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.655916 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.657186 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.657576 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.657705 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.657762 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.658477 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.658556 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:44:47.659226 8724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca8cbb2568492a93739a3e5d1e72a4" candidate_uuid: "90cb719b9a18411d9a9d69e4b331a821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021f970b8224c4689f8a0938a2bf1da" is_pre_election: true
I20260809 15:44:47.659230 8919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca8cbb2568492a93739a3e5d1e72a4" candidate_uuid: "90cb719b9a18411d9a9d69e4b331a821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82486a931d34404b977485371607d713" is_pre_election: true
I20260809 15:44:47.659538 8919 raft_consensus.cc:2454] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cb719b9a18411d9a9d69e4b331a821 in term 0.
I20260809 15:44:47.659550 8724 raft_consensus.cc:2454] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cb719b9a18411d9a9d69e4b331a821 in term 0.
I20260809 15:44:47.660058 9023 leader_election.cc:302] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cb719b9a18411d9a9d69e4b331a821, c021f970b8224c4689f8a0938a2bf1da; no voters:
I20260809 15:44:47.660348 9227 raft_consensus.cc:2781] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:47.660439 9227 raft_consensus.cc:482] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:47.660485 9227 raft_consensus.cc:3037] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:47.661536 9227 raft_consensus.cc:504] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.661881 9227 leader_election.cc:288] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [CANDIDATE]: Term 1 election: Requested vote from peers c021f970b8224c4689f8a0938a2bf1da (127.14.15.129:36389), 82486a931d34404b977485371607d713 (127.14.15.130:34483)
I20260809 15:44:47.662259 8724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca8cbb2568492a93739a3e5d1e72a4" candidate_uuid: "90cb719b9a18411d9a9d69e4b331a821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021f970b8224c4689f8a0938a2bf1da"
I20260809 15:44:47.662329 8919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca8cbb2568492a93739a3e5d1e72a4" candidate_uuid: "90cb719b9a18411d9a9d69e4b331a821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82486a931d34404b977485371607d713"
I20260809 15:44:47.662416 8724 raft_consensus.cc:3037] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:47.662436 8919 raft_consensus.cc:3037] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:47.663693 8724 raft_consensus.cc:2454] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cb719b9a18411d9a9d69e4b331a821 in term 1.
I20260809 15:44:47.663693 8919 raft_consensus.cc:2454] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cb719b9a18411d9a9d69e4b331a821 in term 1.
I20260809 15:44:47.664011 9020 leader_election.cc:302] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82486a931d34404b977485371607d713, 90cb719b9a18411d9a9d69e4b331a821, c021f970b8224c4689f8a0938a2bf1da; no voters:
I20260809 15:44:47.664224 9227 raft_consensus.cc:2781] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:47.664451 9227 raft_consensus.cc:686] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 1 LEADER]: Becoming Leader. State: Replica: 90cb719b9a18411d9a9d69e4b331a821, State: Running, Role: LEADER
I20260809 15:44:47.664770 9227 consensus_queue.cc:237] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } }
I20260809 15:44:47.667984 8493 catalog_manager.cc:5495] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90cb719b9a18411d9a9d69e4b331a821 (127.14.15.131). New cstate: current_term: 1 leader_uuid: "90cb719b9a18411d9a9d69e4b331a821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cb719b9a18411d9a9d69e4b331a821" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20260809 15:44:47.703675 9214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.699953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40344 (local address 127.14.15.131:42737)
0809 15:44:47.700090 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:47.700094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:47.700130 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:44:47.700201 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:47.700203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:47.700259 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:47.700351 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:47.700661 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.701160 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.702134 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:47.702365 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:47.702447 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:47.702791 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:47.703204 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:47.703378 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:47.703503 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 15:44:47.703556 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:44:47.709827 8724 raft_consensus.cc:1261] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 1 FOLLOWER]: Refusing update from remote peer 90cb719b9a18411d9a9d69e4b331a821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:47.709827 8919 raft_consensus.cc:1261] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 1 FOLLOWER]: Refusing update from remote peer 90cb719b9a18411d9a9d69e4b331a821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:47.710654 9227 consensus_queue.cc:1035] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82486a931d34404b977485371607d713" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:47.710916 9234 consensus_queue.cc:1035] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021f970b8224c4689f8a0938a2bf1da" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 36389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:44:47.713142 8986 tablet.cc:2369] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:44:47.716485 9194 tablet.cc:2369] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:47.719259 9242 mvcc.cc:205] Tried to move back new op lower bound from 7316645018451808256 to 7316645018277351424. Current Snapshot: MvccSnapshot[applied={T|T < 7316645018451808256}]
I20260809 15:44:47.724383 9247 mvcc.cc:205] Tried to move back new op lower bound from 7316645018451808256 to 7316645018277351424. Current Snapshot: MvccSnapshot[applied={T|T < 7316645018451808256 or (T in {7316645018451808256})}]
I20260809 15:44:47.728231 8495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:47.728413 8495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:47.730955 8495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba8842f8a02c499c9561f1f19b0499c8: Sending DeleteTablet for 3 replicas of tablet 27ca8cbb2568492a93739a3e5d1e72a4
I20260809 15:44:47.731788 9097 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:47 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:40342
I20260809 15:44:47.732015 8887 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:47 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:33526
I20260809 15:44:47.732317 9261 tablet_replica.cc:330] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: stopping tablet replica
I20260809 15:44:47.732319 8693 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca8cbb2568492a93739a3e5d1e72a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:47 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:55986
I20260809 15:44:47.732622 9261 raft_consensus.cc:2229] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:47.732851 9266 tablet_replica.cc:330] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da: stopping tablet replica
I20260809 15:44:47.733048 9261 raft_consensus.cc:2258] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:47.733152 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 8597
I20260809 15:44:47.733196 9266 raft_consensus.cc:2229] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:47.733516 9266 raft_consensus.cc:2258] T 27ca8cbb2568492a93739a3e5d1e72a4 P c021f970b8224c4689f8a0938a2bf1da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:47.735353 9261 ts_tablet_manager.cc:1905] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:47.739228 9261 ts_tablet_manager.cc:1918] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:47.739344 9261 log.cc:1196] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/27ca8cbb2568492a93739a3e5d1e72a4
I20260809 15:44:47.739804 9261 ts_tablet_manager.cc:1939] T 27ca8cbb2568492a93739a3e5d1e72a4 P 90cb719b9a18411d9a9d69e4b331a821: Deleting consensus metadata
I20260809 15:44:47.742146 8476 catalog_manager.cc:4841] TS 90cb719b9a18411d9a9d69e4b331a821 (127.14.15.131:42737): tablet 27ca8cbb2568492a93739a3e5d1e72a4 (table test-table [id=db05dc00c1284e91b999991ba1f2dd07]) successfully deleted
I20260809 15:44:47.742452 9263 tablet_replica.cc:330] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: stopping tablet replica
I20260809 15:44:47.742756 9263 raft_consensus.cc:2229] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:47.743084 9263 raft_consensus.cc:2258] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:47.744415 9263 ts_tablet_manager.cc:1905] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:47.746629 9263 ts_tablet_manager.cc:1918] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:47.746749 9263 log.cc:1196] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/27ca8cbb2568492a93739a3e5d1e72a4
I20260809 15:44:47.747105 9263 ts_tablet_manager.cc:1939] T 27ca8cbb2568492a93739a3e5d1e72a4 P 82486a931d34404b977485371607d713: Deleting consensus metadata
I20260809 15:44:47.748266 8474 catalog_manager.cc:4841] TS 82486a931d34404b977485371607d713 (127.14.15.130:34483): tablet 27ca8cbb2568492a93739a3e5d1e72a4 (table test-table [id=db05dc00c1284e91b999991ba1f2dd07]) successfully deleted
W20260809 15:44:47.748582 8477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:36389 (error 108)
I20260809 15:44:47.748853 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 8801
I20260809 15:44:47.753398 9215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:47.753033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:36389 (local address 127.0.0.1:55994)
0809 15:44:47.753224 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:47.753299 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:36389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260809 15:44:47.753692 8477 catalog_manager.cc:4584] TS c021f970b8224c4689f8a0938a2bf1da (127.14.15.129:36389): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 27ca8cbb2568492a93739a3e5d1e72a4: Network error: Client connection negotiation failed: client connection to 127.14.15.129:36389: connect: Connection refused (error 111)
I20260809 15:44:47.775293 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 8992
I20260809 15:44:47.785261 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 8449
2026-08-09T15:44:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2679 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T15:44:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:47Z Disabled control of system clock
I20260809 15:44:47.823854 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:45397
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:45397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:47.935447 9274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:47.935693 9274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:47.935726 9274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:47.939568 9274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:47.939613 9274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:47.939628 9274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:47.939644 9274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:47.939659 9274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:47.944195 9274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:45397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:45397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:47.945148 9274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:47.946470 9274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:47.954663 9284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:47.954739 9285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:47.954666 9288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:47.956244 9274 server_base.cc:1034] running on GCE node
I20260809 15:44:47.956785 9274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:47.957823 9274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:47.959030 9274 hybrid_clock.cc:648] HybridClock initialized: now 1786290287959012 us; error 29 us; skew 500 ppm
I20260809 15:44:47.964190 9274 webserver.cc:460] Webserver started at http://127.14.15.190:34639/ using document root <none> and password file <none>
I20260809 15:44:47.964792 9274 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:47.964885 9274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:47.965121 9274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:47.967231 9274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "12e630a430c3400aa2c456ef86dcbd86"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "eefbf156bcb2aed62cf58134442fb8dd"
server_key_iv: "f5aa785b076772d31c4e3de8a7316fd3"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.967787 9274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "12e630a430c3400aa2c456ef86dcbd86"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "eefbf156bcb2aed62cf58134442fb8dd"
server_key_iv: "f5aa785b076772d31c4e3de8a7316fd3"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.971436 9274 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:44:47.973744 9297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:47.974983 9274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:47.975126 9274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "12e630a430c3400aa2c456ef86dcbd86"
format_stamp: "Formatted at 2026-08-09 15:44:47 on dist-test-slave-jztv"
server_key: "eefbf156bcb2aed62cf58134442fb8dd"
server_key_iv: "f5aa785b076772d31c4e3de8a7316fd3"
server_key_version: "encryptionkey@0"
I20260809 15:44:47.975237 9274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:47.997146 9274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:47.997845 9274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:47.998049 9274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:48.005040 9274 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:45397
I20260809 15:44:48.005046 9382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:45397 every 8 connection(s)
I20260809 15:44:48.005928 9274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:48.008932 9383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:48.009872 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 9274
I20260809 15:44:48.010012 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:48.010416 14398 external_mini_cluster.cc:1428] Setting key c4d1db7c969884fc06dfab1e6e0592f7
I20260809 15:44:48.015045 9383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: Bootstrap starting.
I20260809 15:44:48.017244 9383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:48.018050 9383 log.cc:824] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:48.019781 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.011833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52848 (local address 127.14.15.190:45397)
0809 15:44:48.012441 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.012455 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.012489 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:44:48.013111 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.013126 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.013561 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.013872 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:48.014369 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.015388 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.016271 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.016734 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.016904 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.017783 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:48.017796 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:48.017808 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:48.018265 (+ 457us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:48.018335 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:48.018356 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:48.018464 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.018616 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.018881 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":134,"threads_started":1}
I20260809 15:44:48.020257 9383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: No bootstrap required, opened a new log
I20260809 15:44:48.024189 9383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } }
I20260809 15:44:48.024422 9383 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:48.024456 9383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e630a430c3400aa2c456ef86dcbd86, State: Initialized, Role: FOLLOWER
I20260809 15:44:48.024901 9383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } }
I20260809 15:44:48.025098 9383 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:48.025197 9383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:48.025326 9383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:48.026388 9383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } }
I20260809 15:44:48.026736 9383 leader_election.cc:302] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e630a430c3400aa2c456ef86dcbd86; no voters:
I20260809 15:44:48.027052 9383 leader_election.cc:288] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:48.027211 9392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:48.027446 9392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [term 1 LEADER]: Becoming Leader. State: Replica: 12e630a430c3400aa2c456ef86dcbd86, State: Running, Role: LEADER
I20260809 15:44:48.027778 9392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } }
I20260809 15:44:48.028296 9383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:48.029484 9393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12e630a430c3400aa2c456ef86dcbd86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } } }
I20260809 15:44:48.029637 9393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:48.029965 9395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e630a430c3400aa2c456ef86dcbd86. Latest consensus state: current_term: 1 leader_uuid: "12e630a430c3400aa2c456ef86dcbd86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e630a430c3400aa2c456ef86dcbd86" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 45397 } } }
I20260809 15:44:48.030107 9395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:48.030078 9404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:48.033074 9404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:48.038781 9404 catalog_manager.cc:1347] Generated new cluster ID: bd92d40b994d4bd880114555bf960036
I20260809 15:44:48.038848 9404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:48.060254 9404 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:48.061488 9404 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:48.073503 9404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: Generated new TSK 0
I20260809 15:44:48.074385 9404 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:48.084172 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--builtin_ntp_servers=127.14.15.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:48.199136 9420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:48.199478 9420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:48.199577 9420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:48.203773 9420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:48.203846 9420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:48.203938 9420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:48.208658 9420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:48.209743 9420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:48.211258 9420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:48.220738 9431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:48.220749 9428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:48.220875 9420 server_base.cc:1034] running on GCE node
W20260809 15:44:48.220738 9429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:48.221438 9420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:48.222054 9420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:48.223237 9420 hybrid_clock.cc:648] HybridClock initialized: now 1786290288223213 us; error 49 us; skew 500 ppm
I20260809 15:44:48.225106 9420 webserver.cc:460] Webserver started at http://127.14.15.129:39271/ using document root <none> and password file <none>
I20260809 15:44:48.225694 9420 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:48.225790 9420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:48.226040 9420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:48.228149 9420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "f93b3eb971e04761950a5ef2e09e3999"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "bf160a4e8f72e2c79d90170de2636682"
server_key_iv: "2d73ba8e85205ea4a1fb3c22c3fb1580"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.228776 9420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "f93b3eb971e04761950a5ef2e09e3999"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "bf160a4e8f72e2c79d90170de2636682"
server_key_iv: "2d73ba8e85205ea4a1fb3c22c3fb1580"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.232470 9420 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 15:44:48.234865 9437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.236027 9420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:44:48.236171 9420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "f93b3eb971e04761950a5ef2e09e3999"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "bf160a4e8f72e2c79d90170de2636682"
server_key_iv: "2d73ba8e85205ea4a1fb3c22c3fb1580"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.236281 9420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:48.253504 9420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:48.254201 9420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:48.254437 9420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:48.255015 9420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:48.255949 9420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:48.256021 9420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.256119 9420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:48.256170 9420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.265089 9420 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:38599
I20260809 15:44:48.265118 9617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:38599 every 8 connection(s)
I20260809 15:44:48.265939 9420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:48.271672 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 9420
I20260809 15:44:48.271832 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:48.272183 14398 external_mini_cluster.cc:1428] Setting key 953c2064a558c8edb7ba3d27c8494ca8
I20260809 15:44:48.274302 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--builtin_ntp_servers=127.14.15.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:48.276502 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.267663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:48955 (local address 127.14.15.190:45397)
0809 15:44:48.267840 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.267844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.268836 (+ 992us) server_negotiation.cc:407] Connection header received
0809 15:44:48.270170 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.270173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.270264 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.270353 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:48.271187 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.271725 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.273123 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.273454 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.273573 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.275986 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:48.275989 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:48.275991 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:48.276003 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:48.276023 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:48.276030 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:48.276122 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.276291 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.276361 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 15:44:48.277360 9621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.268058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:45397 (local address 127.14.15.129:48955)
0809 15:44:48.268683 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.268724 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.269977 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.270511 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.270518 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.270597 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:48.271062 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.271075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.271890 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.271895 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.273005 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.273016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.273638 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.273642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.273829 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.275681 (+ 1852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:48.275685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:48.275740 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:48.275824 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:48.276126 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:48.276140 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:48.276149 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.276288 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.276625 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":108,"threads_started":1}
I20260809 15:44:48.278625 9618 heartbeater.cc:347] Connected to a master server at 127.14.15.190:45397
I20260809 15:44:48.278862 9618 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:48.279568 9618 heartbeater.cc:511] Master 127.14.15.190:45397 requested a full tablet report, sending...
I20260809 15:44:48.281517 9320 ts_manager.cc:194] Registered new tserver with Master: f93b3eb971e04761950a5ef2e09e3999 (127.14.15.129:38599)
I20260809 15:44:48.283249 9320 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.129:48955
W20260809 15:44:48.389927 9622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:48.390267 9622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:48.390353 9622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:48.394341 9622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:48.394435 9622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:48.394531 9622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:48.399412 9622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:48.400600 9622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:48.402019 9622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:48.411777 9634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:48.411762 9633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:48.411813 9637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:48.411862 9622 server_base.cc:1034] running on GCE node
I20260809 15:44:48.412499 9622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:48.413081 9622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:48.414281 9622 hybrid_clock.cc:648] HybridClock initialized: now 1786290288414261 us; error 30 us; skew 500 ppm
I20260809 15:44:48.416145 9622 webserver.cc:460] Webserver started at http://127.14.15.130:41617/ using document root <none> and password file <none>
I20260809 15:44:48.416796 9622 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:48.416894 9622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:48.417140 9622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:48.419275 9622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "3caa7c47bac6463f9a3c4872cdcae1dc"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "dc8ac8990d2b506331c63ceb443ff048"
server_key_iv: "ac0f7680adf56597b453ddc2b29422e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.419806 9622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "3caa7c47bac6463f9a3c4872cdcae1dc"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "dc8ac8990d2b506331c63ceb443ff048"
server_key_iv: "ac0f7680adf56597b453ddc2b29422e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.423399 9622 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:44:48.425705 9647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.426955 9622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:44:48.427098 9622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "3caa7c47bac6463f9a3c4872cdcae1dc"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "dc8ac8990d2b506331c63ceb443ff048"
server_key_iv: "ac0f7680adf56597b453ddc2b29422e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.427201 9622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:48.449816 9622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:48.450640 9622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:48.450852 9622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:48.451491 9622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:48.452507 9622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:48.452555 9622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.452627 9622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:48.452661 9622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.461648 9622 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:38071
I20260809 15:44:48.461684 9824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:38071 every 8 connection(s)
I20260809 15:44:48.462880 9622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:48.472333 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.464846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56889 (local address 127.14.15.190:45397)
0809 15:44:48.465004 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.465007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.465993 (+ 986us) server_negotiation.cc:407] Connection header received
0809 15:44:48.467483 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.467487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.467548 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.467632 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:48.468536 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.469100 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.470286 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.470512 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.470632 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.471779 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:48.471783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:48.471786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:48.471806 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:48.471827 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:48.471835 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:48.471917 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.472084 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.472176 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:44:48.472491 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 9622
I20260809 15:44:48.472630 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:48.472922 14398 external_mini_cluster.cc:1428] Setting key f6a0e2b327017a491bec16c16e15da62
I20260809 15:44:48.473347 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.465156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:45397 (local address 127.14.15.130:56889)
0809 15:44:48.465824 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.465865 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.467252 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.467813 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.467820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.467906 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:48.468385 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.468398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.469240 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.469244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.470131 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.470140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.470679 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.470683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.470846 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.471499 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:48.471501 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:48.471548 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:48.471616 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:48.471920 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:48.471932 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:48.471940 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.472084 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.472384 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":117,"threads_started":1}
I20260809 15:44:48.474627 9826 heartbeater.cc:347] Connected to a master server at 127.14.15.190:45397
I20260809 15:44:48.474874 9826 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:48.475266 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--builtin_ntp_servers=127.14.15.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:48.475524 9826 heartbeater.cc:511] Master 127.14.15.190:45397 requested a full tablet report, sending...
I20260809 15:44:48.476716 9320 ts_manager.cc:194] Registered new tserver with Master: 3caa7c47bac6463f9a3c4872cdcae1dc (127.14.15.130:38071)
I20260809 15:44:48.477553 9320 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.130:56889
W20260809 15:44:48.593683 9829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:48.593961 9829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:48.594000 9829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:48.598011 9829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:48.598074 9829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:48.598129 9829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:48.602991 9829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:48.604099 9829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:48.605455 9829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:48.615032 9841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:48.615118 9834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:48.615033 9836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:48.615268 9829 server_base.cc:1034] running on GCE node
I20260809 15:44:48.615839 9829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:48.616475 9829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:48.617676 9829 hybrid_clock.cc:648] HybridClock initialized: now 1786290288617658 us; error 29 us; skew 500 ppm
I20260809 15:44:48.619581 9829 webserver.cc:460] Webserver started at http://127.14.15.131:46527/ using document root <none> and password file <none>
I20260809 15:44:48.620172 9829 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:48.620270 9829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:48.620509 9829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:48.622622 9829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "e550f3e99e5f46308f8d020c64b11baf"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "41ab94257b5e65b56819827e423e78d3"
server_key_iv: "12fac93c292cac3f2bd0bea737462b12"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.623193 9829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "e550f3e99e5f46308f8d020c64b11baf"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "41ab94257b5e65b56819827e423e78d3"
server_key_iv: "12fac93c292cac3f2bd0bea737462b12"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.626797 9829 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:44:48.629293 9854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.630681 9829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:48.630810 9829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "e550f3e99e5f46308f8d020c64b11baf"
format_stamp: "Formatted at 2026-08-09 15:44:48 on dist-test-slave-jztv"
server_key: "41ab94257b5e65b56819827e423e78d3"
server_key_iv: "12fac93c292cac3f2bd0bea737462b12"
server_key_version: "encryptionkey@0"
I20260809 15:44:48.630925 9829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:48.654007 9829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:48.654793 9829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:48.655004 9829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:48.655615 9829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:48.656562 9829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:48.656634 9829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.656709 9829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:48.656754 9829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:48.665723 9829 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:43195
I20260809 15:44:48.665753 10039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:43195 every 8 connection(s)
I20260809 15:44:48.666641 9829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:48.673697 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 9829
I20260809 15:44:48.673835 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:48.674152 14398 external_mini_cluster.cc:1428] Setting key 6b81be0f51744f9f4233a854681452f9
I20260809 15:44:48.676086 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.668441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:38311 (local address 127.14.15.190:45397)
0809 15:44:48.668596 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.668600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.669670 (+ 1070us) server_negotiation.cc:407] Connection header received
0809 15:44:48.671107 (+ 1437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.671110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.671158 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.671233 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:48.672091 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.672616 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.673733 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.674086 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.674201 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.675576 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:48.675579 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:48.675581 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:48.675592 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:48.675613 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:48.675620 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:48.675732 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.675882 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.675948 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:44:48.676935 10042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.668897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:45397 (local address 127.14.15.131:38311)
0809 15:44:48.669524 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.669566 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.670908 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.671389 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.671396 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.671476 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:48.671954 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.671968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.672726 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.672728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.673612 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.673623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.674348 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.674352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.674554 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.675271 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:48.675274 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:48.675326 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:48.675413 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:48.675744 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:48.675752 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:48.675757 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.675856 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.676073 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":113,"threads_started":1}
I20260809 15:44:48.678006 10040 heartbeater.cc:347] Connected to a master server at 127.14.15.190:45397
I20260809 15:44:48.678308 10040 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:48.678849 10040 heartbeater.cc:511] Master 127.14.15.190:45397 requested a full tablet report, sending...
I20260809 15:44:48.679898 9320 ts_manager.cc:194] Registered new tserver with Master: e550f3e99e5f46308f8d020c64b11baf (127.14.15.131:43195)
I20260809 15:44:48.680495 9320 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.131:38311
I20260809 15:44:48.688244 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:48.693861 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.690337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.14.15.190:45397)
0809 15:44:48.690490 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.690493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.690612 (+ 119us) server_negotiation.cc:407] Connection header received
0809 15:44:48.690714 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.690716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.690757 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.690828 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:48.691087 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.691592 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.692377 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.692581 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.692653 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.693438 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:48.693441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:48.693443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:48.693455 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:48.693474 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:48.693482 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:48.693591 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.693715 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.693750 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:44:48.696887 9320 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:48.699958 9320 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:48.714763 10069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.709663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.14.15.131:43195)
0809 15:44:48.710263 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.710275 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.710297 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:44:48.710368 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.710373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.710557 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.710702 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:48.710935 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.712007 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.713433 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714036 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714163 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714385 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.714504 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.714596 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":142,"threads_started":1}
I20260809 15:44:48.714756 10061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.709154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:43195 (local address 127.0.0.1:34750)
0809 15:44:48.710087 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.710100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.710183 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.710688 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.710693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.710716 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:48.710803 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.710811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.712129 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.712132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.713307 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.713315 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714164 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.714318 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714361 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.714475 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.714596 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260809 15:44:48.715170 10059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.708443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:38599 (local address 127.0.0.1:46154)
0809 15:44:48.708962 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.709010 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.709142 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.710263 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.710271 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.710298 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:48.710436 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.710443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.711938 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.711941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.713282 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.713294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714272 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.714792 (+ 517us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714871 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.714944 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.715039 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":496,"thread_start_us":107,"threads_started":1}
I20260809 15:44:48.715312 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.709241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38044 (local address 127.14.15.130:38071)
0809 15:44:48.710010 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.710023 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.710048 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:44:48.710131 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.710139 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.710372 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.710527 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:48.710773 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.711575 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.713203 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714078 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714332 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714538 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.715039 (+ 501us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.715134 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":204,"threads_started":1}
I20260809 15:44:48.716008 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.708655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46154 (local address 127.14.15.129:38599)
0809 15:44:48.709554 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.709568 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.709596 (+ 28us) server_negotiation.cc:407] Connection header received
0809 15:44:48.709677 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.709683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.709892 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.710048 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:48.710586 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.711821 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.713412 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714143 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714332 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714538 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.715719 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.715821 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":115,"threads_started":1}
I20260809 15:44:48.715581 10067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.708660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38071 (local address 127.0.0.1:38044)
0809 15:44:48.709577 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.709593 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.709700 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.710506 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.710509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.710528 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:48.710634 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.710644 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.711704 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.711710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.713075 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.713086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.714262 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.714266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.714788 (+ 522us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.714866 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.714944 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.715459 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":865,"thread_start_us":103,"threads_started":1}
I20260809 15:44:48.719082 9730 tablet_service.cc:1467] Processing CreateTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 (DEFAULT_TABLE table=test-table [id=64df1b22a98645c6a5a85b7d4d1941eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:48.720355 9730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a90a218aac242d7a7154db03b4cb7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:48.720171 9512 tablet_service.cc:1467] Processing CreateTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 (DEFAULT_TABLE table=test-table [id=64df1b22a98645c6a5a85b7d4d1941eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:48.721099 9512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a90a218aac242d7a7154db03b4cb7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:48.724682 9934 tablet_service.cc:1467] Processing CreateTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 (DEFAULT_TABLE table=test-table [id=64df1b22a98645c6a5a85b7d4d1941eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:48.725761 9934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a90a218aac242d7a7154db03b4cb7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:48.726712 10070 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Bootstrap starting.
I20260809 15:44:48.728143 10071 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Bootstrap starting.
I20260809 15:44:48.729074 10070 tablet_bootstrap.cc:654] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:48.729926 10070 log.cc:824] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:48.730422 10071 tablet_bootstrap.cc:654] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:48.731317 10071 log.cc:824] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:48.732662 10070 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: No bootstrap required, opened a new log
I20260809 15:44:48.732879 10070 ts_tablet_manager.cc:1397] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:44:48.733080 10075 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Bootstrap starting.
I20260809 15:44:48.733565 10071 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: No bootstrap required, opened a new log
I20260809 15:44:48.733774 10071 ts_tablet_manager.cc:1397] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:44:48.735386 10075 tablet_bootstrap.cc:654] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:48.736249 10075 log.cc:824] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:48.737576 10071 raft_consensus.cc:348] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.737958 10071 raft_consensus.cc:374] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:48.737775 10070 raft_consensus.cc:348] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.738050 10070 raft_consensus.cc:374] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:48.738118 10071 raft_consensus.cc:729] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f93b3eb971e04761950a5ef2e09e3999, State: Initialized, Role: FOLLOWER
I20260809 15:44:48.738152 10070 raft_consensus.cc:729] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3caa7c47bac6463f9a3c4872cdcae1dc, State: Initialized, Role: FOLLOWER
I20260809 15:44:48.738669 10075 tablet_bootstrap.cc:492] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: No bootstrap required, opened a new log
I20260809 15:44:48.738665 10070 consensus_queue.cc:260] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.738737 10071 consensus_queue.cc:260] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.738858 10075 ts_tablet_manager.cc:1397] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:44:48.739403 9826 heartbeater.cc:503] Master 127.14.15.190:45397 was elected leader, sending a full tablet report...
I20260809 15:44:48.739740 10070 ts_tablet_manager.cc:1428] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 15:44:48.739753 10071 ts_tablet_manager.cc:1428] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:48.740114 9618 heartbeater.cc:503] Master 127.14.15.190:45397 was elected leader, sending a full tablet report...
I20260809 15:44:48.743949 10075 raft_consensus.cc:348] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.744256 10075 raft_consensus.cc:374] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:48.744323 10075 raft_consensus.cc:729] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e550f3e99e5f46308f8d020c64b11baf, State: Initialized, Role: FOLLOWER
I20260809 15:44:48.744725 10075 consensus_queue.cc:260] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.745359 10040 heartbeater.cc:503] Master 127.14.15.190:45397 was elected leader, sending a full tablet report...
I20260809 15:44:48.745682 10075 ts_tablet_manager.cc:1428] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260809 15:44:48.767134 9619 tablet.cc:2369] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:48.830132 10084 raft_consensus.cc:482] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:48.830412 10084 raft_consensus.cc:504] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.831713 10084 leader_election.cc:288] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f93b3eb971e04761950a5ef2e09e3999 (127.14.15.129:38599), 3caa7c47bac6463f9a3c4872cdcae1dc (127.14.15.130:38071)
I20260809 15:44:48.835443 10042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.831928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:38599 (local address 127.14.15.131:41523)
0809 15:44:48.832054 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.832070 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.832172 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.832439 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.832442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.832460 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:48.832582 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.832589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.833323 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.833328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.834280 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.834298 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.835002 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.835006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.835112 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.835135 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.835221 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.835303 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 15:44:48.835496 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.832075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:41523 (local address 127.14.15.129:38599)
0809 15:44:48.832198 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.832205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.832221 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:44:48.832278 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.832281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.832333 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.832418 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:48.832701 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.833208 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.834407 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.834882 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.835010 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.835064 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.835269 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.835351 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:44:48.835765 10087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.831930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:38071 (local address 127.14.15.131:47475)
0809 15:44:48.832423 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.832435 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:48.832574 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:48.832840 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:48.832843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:48.832858 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:48.832994 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.832999 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.833707 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.833714 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.834660 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:48.834670 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.835338 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.835342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:48.835431 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.835457 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:44:48.835532 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:44:48.835619 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":149,"thread_start_us":120,"threads_started":1}
I20260809 15:44:48.835788 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.832043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:47475 (local address 127.14.15.130:38071)
0809 15:44:48.832182 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.832188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.832528 (+ 340us) server_negotiation.cc:407] Connection header received
0809 15:44:48.832691 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.832694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.832746 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.832831 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:48.833107 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.833598 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.834780 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.835178 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.835342 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.835385 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.835566 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.835646 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:44:48.836267 9548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a90a218aac242d7a7154db03b4cb7c7" candidate_uuid: "e550f3e99e5f46308f8d020c64b11baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f93b3eb971e04761950a5ef2e09e3999" is_pre_election: true
I20260809 15:44:48.836591 9548 raft_consensus.cc:2454] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e550f3e99e5f46308f8d020c64b11baf in term 0.
I20260809 15:44:48.836472 9758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a90a218aac242d7a7154db03b4cb7c7" candidate_uuid: "e550f3e99e5f46308f8d020c64b11baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" is_pre_election: true
I20260809 15:44:48.836897 9758 raft_consensus.cc:2454] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e550f3e99e5f46308f8d020c64b11baf in term 0.
I20260809 15:44:48.837152 9855 leader_election.cc:302] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e550f3e99e5f46308f8d020c64b11baf, f93b3eb971e04761950a5ef2e09e3999; no voters:
I20260809 15:44:48.837466 10084 raft_consensus.cc:2781] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:48.837550 10084 raft_consensus.cc:482] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:48.837584 10084 raft_consensus.cc:3037] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:48.838701 10084 raft_consensus.cc:504] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.839084 10084 leader_election.cc:288] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [CANDIDATE]: Term 1 election: Requested vote from peers f93b3eb971e04761950a5ef2e09e3999 (127.14.15.129:38599), 3caa7c47bac6463f9a3c4872cdcae1dc (127.14.15.130:38071)
I20260809 15:44:48.839480 9548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a90a218aac242d7a7154db03b4cb7c7" candidate_uuid: "e550f3e99e5f46308f8d020c64b11baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f93b3eb971e04761950a5ef2e09e3999"
I20260809 15:44:48.839632 9548 raft_consensus.cc:3037] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:48.840701 9548 raft_consensus.cc:2454] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e550f3e99e5f46308f8d020c64b11baf in term 1.
I20260809 15:44:48.841039 9855 leader_election.cc:302] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e550f3e99e5f46308f8d020c64b11baf, f93b3eb971e04761950a5ef2e09e3999; no voters:
I20260809 15:44:48.841012 9758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a90a218aac242d7a7154db03b4cb7c7" candidate_uuid: "e550f3e99e5f46308f8d020c64b11baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc"
I20260809 15:44:48.841218 10084 raft_consensus.cc:2781] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:48.841156 9758 raft_consensus.cc:3037] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:48.841467 10084 raft_consensus.cc:686] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 1 LEADER]: Becoming Leader. State: Replica: e550f3e99e5f46308f8d020c64b11baf, State: Running, Role: LEADER
I20260809 15:44:48.841853 10084 consensus_queue.cc:237] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } }
I20260809 15:44:48.842521 9758 raft_consensus.cc:2454] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e550f3e99e5f46308f8d020c64b11baf in term 1.
I20260809 15:44:48.845516 9319 catalog_manager.cc:5495] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf reported cstate change: term changed from 0 to 1, leader changed from <none> to e550f3e99e5f46308f8d020c64b11baf (127.14.15.131). New cstate: current_term: 1 leader_uuid: "e550f3e99e5f46308f8d020c64b11baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e550f3e99e5f46308f8d020c64b11baf" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 43195 } health_report { overall_health: HEALTHY } } }
I20260809 15:44:48.866642 10069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.862977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.14.15.131:43195)
0809 15:44:48.863135 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:48.863141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:48.863157 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:44:48.863234 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:48.863236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:48.863291 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:48.863405 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:48.863671 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.864174 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.865054 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:48.865260 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:48.865372 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:48.865680 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:48.866152 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:48.866345 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:48.866439 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 15:44:48.866475 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:44:48.872721 9758 raft_consensus.cc:1261] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 1 FOLLOWER]: Refusing update from remote peer e550f3e99e5f46308f8d020c64b11baf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:48.872721 9548 raft_consensus.cc:1261] T 1a90a218aac242d7a7154db03b4cb7c7 P f93b3eb971e04761950a5ef2e09e3999 [term 1 FOLLOWER]: Refusing update from remote peer e550f3e99e5f46308f8d020c64b11baf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:48.873481 10089 consensus_queue.cc:1035] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3caa7c47bac6463f9a3c4872cdcae1dc" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:48.873692 10084 consensus_queue.cc:1035] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f93b3eb971e04761950a5ef2e09e3999" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:48.881942 10100 mvcc.cc:205] Tried to move back new op lower bound from 7316645023214829568 to 7316645023099879424. Current Snapshot: MvccSnapshot[applied={T|T < 7316645023214829568}]
I20260809 15:44:48.883708 10095 mvcc.cc:205] Tried to move back new op lower bound from 7316645023214829568 to 7316645023099879424. Current Snapshot: MvccSnapshot[applied={T|T < 7316645023214829568 or (T in {7316645023214829568})}]
I20260809 15:44:48.890479 9318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:48.890682 9318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:48.893141 9318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 12e630a430c3400aa2c456ef86dcbd86: Sending DeleteTablet for 3 replicas of tablet 1a90a218aac242d7a7154db03b4cb7c7
I20260809 15:44:48.894024 9730 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:48 UTC) from {username='slave'} at 127.0.0.1:38044
I20260809 15:44:48.894200 9512 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:48 UTC) from {username='slave'} at 127.0.0.1:46154
I20260809 15:44:48.894189 9934 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a90a218aac242d7a7154db03b4cb7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:48 UTC) from {username='slave'} at 127.0.0.1:34750
I20260809 15:44:48.894642 10113 tablet_replica.cc:330] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: stopping tablet replica
I20260809 15:44:48.894712 10115 tablet_replica.cc:330] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: stopping tablet replica
I20260809 15:44:48.895030 10113 raft_consensus.cc:2229] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:48.895066 10115 raft_consensus.cc:2229] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:48.895136 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 9420
I20260809 15:44:48.895443 10113 raft_consensus.cc:2258] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:48.899029 10113 ts_tablet_manager.cc:1905] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:48.902395 10113 ts_tablet_manager.cc:1918] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:48.902558 10113 log.cc:1196] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/1a90a218aac242d7a7154db03b4cb7c7
I20260809 15:44:48.902930 10113 ts_tablet_manager.cc:1939] T 1a90a218aac242d7a7154db03b4cb7c7 P 3caa7c47bac6463f9a3c4872cdcae1dc: Deleting consensus metadata
I20260809 15:44:48.904150 10115 raft_consensus.cc:2258] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:48.904397 9300 catalog_manager.cc:4841] TS 3caa7c47bac6463f9a3c4872cdcae1dc (127.14.15.130:38071): tablet 1a90a218aac242d7a7154db03b4cb7c7 (table test-table [id=64df1b22a98645c6a5a85b7d4d1941eb]) successfully deleted
I20260809 15:44:48.905990 10115 ts_tablet_manager.cc:1905] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:48.909545 10115 ts_tablet_manager.cc:1918] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:48.909659 10115 log.cc:1196] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/1a90a218aac242d7a7154db03b4cb7c7
I20260809 15:44:48.910068 10115 ts_tablet_manager.cc:1939] T 1a90a218aac242d7a7154db03b4cb7c7 P e550f3e99e5f46308f8d020c64b11baf: Deleting consensus metadata
W20260809 15:44:48.910872 9299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:38599 (error 108)
I20260809 15:44:48.911509 9299 catalog_manager.cc:4841] TS e550f3e99e5f46308f8d020c64b11baf (127.14.15.131:43195): tablet 1a90a218aac242d7a7154db03b4cb7c7 (table test-table [id=64df1b22a98645c6a5a85b7d4d1941eb]) successfully deleted
I20260809 15:44:48.911945 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 9622
I20260809 15:44:48.912182 10059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:48.911847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:38599 (local address 127.0.0.1:46164)
0809 15:44:48.911994 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:48.912082 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:38599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 15:44:48.920596 9299 catalog_manager.cc:4584] TS f93b3eb971e04761950a5ef2e09e3999 (127.14.15.129:38599): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a90a218aac242d7a7154db03b4cb7c7: Network error: Client connection negotiation failed: client connection to 127.14.15.129:38599: connect: Connection refused (error 111)
I20260809 15:44:48.937134 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 9829
I20260809 15:44:48.947561 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 9274
2026-08-09T15:44:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1159 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:49 dist-test-slave-jztv krb5kdc[10123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:49 dist-test-slave-jztv krb5kdc[10123](info): set up 2 sockets
Aug 09 15:44:49 dist-test-slave-jztv krb5kdc[10123](info): commencing operation
krb5kdc: starting...
W20260809 15:44:50.180051 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:44:50.315156 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42919
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:42919
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:50.427750 10143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:50.428017 10143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:50.428064 10143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:50.432077 10143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:50.432133 10143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:50.432153 10143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:50.432169 10143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:50.432184 10143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:50.437424 10143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:42919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:42919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:50.438516 10143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:50.439589 10143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:50.448267 10152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:50.448257 10151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:50.448230 10155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:50.448426 10143 server_base.cc:1034] running on GCE node
I20260809 15:44:50.449184 10143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:50.450323 10143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:50.451494 10143 hybrid_clock.cc:648] HybridClock initialized: now 1786290290451480 us; error 27 us; skew 500 ppm
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:50.454284 10143 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:44:50.455207 10143 webserver.cc:460] Webserver started at http://127.14.15.190:45141/ using document root <none> and password file <none>
I20260809 15:44:50.455775 10143 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:50.455869 10143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:50.456113 10143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:50.458160 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "942cc0c665094b5dbeb4fa41b0684abe"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "1ce65c5757c543089a3fcee07c518522"
server_key_iv: "f13f2a2eb67d81e9f032dfda13770f02"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.458804 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "942cc0c665094b5dbeb4fa41b0684abe"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "1ce65c5757c543089a3fcee07c518522"
server_key_iv: "f13f2a2eb67d81e9f032dfda13770f02"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.462536 10143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:50.464900 10171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:50.466077 10143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:50.466284 10143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "942cc0c665094b5dbeb4fa41b0684abe"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "1ce65c5757c543089a3fcee07c518522"
server_key_iv: "f13f2a2eb67d81e9f032dfda13770f02"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.466408 10143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:50.477828 10143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:50.480680 10143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:50.480893 10143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:50.488853 10143 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:42919
I20260809 15:44:50.488867 10247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:42919 every 8 connection(s)
I20260809 15:44:50.489791 10143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:50.491834 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 10143
I20260809 15:44:50.491989 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:50.492309 14398 external_mini_cluster.cc:1428] Setting key 36cc767d7def6922b015e4ca567baf08
I20260809 15:44:50.492938 10248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:50.499920 10248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: Bootstrap starting.
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:50.502660 10248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:50.503507 10248 log.cc:824] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:50.505770 10248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: No bootstrap required, opened a new log
I20260809 15:44:50.506755 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:50.493689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55390 (local address 127.14.15.190:42919)
0809 15:44:50.494107 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:50.494136 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:50.494171 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:44:50.494882 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:50.494898 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:50.495244 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:50.495531 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:50.496472 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.497446 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.498663 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.499117 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.499238 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:50.501989 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:50.501994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:50.502007 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:50.502042 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:50.503910 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:50.504361 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:50.504366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:50.504370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:50.504480 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:50.504775 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:50.504777 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:50.504778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:50.505170 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:50.505309 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:50.505636 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 15:44:50.505937 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":142,"threads_started":1}
I20260809 15:44:50.509403 10248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } }
I20260809 15:44:50.509645 10248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:50.509728 10248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 942cc0c665094b5dbeb4fa41b0684abe, State: Initialized, Role: FOLLOWER
I20260809 15:44:50.510171 10248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } }
I20260809 15:44:50.510375 10248 raft_consensus.cc:388] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:50.510461 10248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:50.510562 10248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:50.511479 10248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } }
I20260809 15:44:50.511817 10248 leader_election.cc:302] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 942cc0c665094b5dbeb4fa41b0684abe; no voters:
I20260809 15:44:50.512128 10248 leader_election.cc:288] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:50.512264 10255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:50.512506 10255 raft_consensus.cc:686] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [term 1 LEADER]: Becoming Leader. State: Replica: 942cc0c665094b5dbeb4fa41b0684abe, State: Running, Role: LEADER
I20260809 15:44:50.512898 10255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } }
I20260809 15:44:50.513406 10248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:50.514663 10258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 942cc0c665094b5dbeb4fa41b0684abe. Latest consensus state: current_term: 1 leader_uuid: "942cc0c665094b5dbeb4fa41b0684abe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } } }
I20260809 15:44:50.514813 10258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:50.515120 10256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "942cc0c665094b5dbeb4fa41b0684abe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942cc0c665094b5dbeb4fa41b0684abe" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 42919 } } }
I20260809 15:44:50.515185 10267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:50.515275 10256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:50.518273 10267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:50.523486 10267 catalog_manager.cc:1347] Generated new cluster ID: f5f8089c53354430ab1af0c055e716bf
I20260809 15:44:50.523559 10267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:50.540272 10267 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:50.541385 10267 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:50.547663 10267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: Generated new TSK 0
I20260809 15:44:50.548523 10267 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.15.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
Entry for principal kudu/127.14.15.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab.
I20260809 15:44:50.586400 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:50.702598 10284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:50.702939 10284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:50.702991 10284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:50.706909 10284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:50.706956 10284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:50.707010 10284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:50.712136 10284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.129.keytab
--principal=kudu/127.14.15.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:50.713233 10284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:50.714481 10284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:50.724774 10296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:50.726054 10284 server_base.cc:1034] running on GCE node
W20260809 15:44:50.726097 10293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:50.726305 10290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:50.726759 10284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:50.727514 10284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:50.735661 10284 hybrid_clock.cc:648] HybridClock initialized: now 1786290290735629 us; error 68 us; skew 500 ppm
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:50.738524 10284 init.cc:377] Logged in from keytab as kudu/127.14.15.129@KRBTEST.COM (short username kudu)
I20260809 15:44:50.739477 10284 webserver.cc:460] Webserver started at http://127.14.15.129:38427/ using document root <none> and password file <none>
I20260809 15:44:50.740070 10284 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:50.740134 10284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:50.740381 10284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:50.742609 10284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "f15b0ee89e0b4b86bcaa54e28d753087"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "da077cfe5513c3a68d50641f88e6f1b9"
server_key_iv: "7752b191493c266b69aff8c99b611398"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.743192 10284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "f15b0ee89e0b4b86bcaa54e28d753087"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "da077cfe5513c3a68d50641f88e6f1b9"
server_key_iv: "7752b191493c266b69aff8c99b611398"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.747092 10284 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:44:50.749543 10308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:50.750939 10284 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:44:50.751086 10284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "f15b0ee89e0b4b86bcaa54e28d753087"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "da077cfe5513c3a68d50641f88e6f1b9"
server_key_iv: "7752b191493c266b69aff8c99b611398"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.751205 10284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:50.771687 10284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:50.774837 10284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:50.774993 10284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:50.775511 10284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:50.776299 10284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:50.776355 10284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:50.776396 10284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:50.776419 10284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:50.785297 10284 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:37495
I20260809 15:44:50.785349 10491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:37495 every 8 connection(s)
I20260809 15:44:50.786270 10284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:50.794456 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 10284
I20260809 15:44:50.794562 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:50.794821 14398 external_mini_cluster.cc:1428] Setting key f02d56d47f39e98ca77a4e35a2ccdb93
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.129@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:50.800473 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:50.788063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:43111 (local address 127.14.15.190:42919)
0809 15:44:50.788205 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:50.788209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:50.789025 (+ 816us) server_negotiation.cc:407] Connection header received
0809 15:44:50.790329 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:50.790333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:50.790409 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:50.790488 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:50.791606 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.792138 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.793232 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.793469 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.793561 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:50.796614 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:50.796617 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:50.796620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:50.796643 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:50.798127 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:50.798728 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:50.798734 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:50.798737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:50.798843 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:50.799208 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:50.799214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:50.799217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:50.799493 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:50.799610 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:50.800077 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 15:44:50.800230 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:44:50.801054 10496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:50.788423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42919 (local address 127.14.15.129:43111)
0809 15:44:50.788860 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:50.788901 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:50.790076 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:50.790652 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:50.790658 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:50.790991 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:50.791468 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:50.791481 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.792255 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.792258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:50.793111 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:50.793120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:50.793608 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:50.793611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:50.793747 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:50.794729 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:50.794745 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:50.796442 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:50.798272 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:50.798280 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:50.798298 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:50.798623 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:50.798962 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:50.798965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:50.798966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:50.799101 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:50.799610 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:50.799615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:50.799837 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 15:44:50.799978 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 15:44:50.800219 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":117,"threads_started":1}
I20260809 15:44:50.802405 10492 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42919
I20260809 15:44:50.802639 10492 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:50.803113 10492 heartbeater.cc:511] Master 127.14.15.190:42919 requested a full tablet report, sending...
I20260809 15:44:50.804563 10193 ts_manager.cc:194] Registered new tserver with Master: f15b0ee89e0b4b86bcaa54e28d753087 (127.14.15.129:37495)
I20260809 15:44:50.805691 10193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.129@KRBTEST.COM'} at 127.14.15.129:43111
WARNING: no policy specified for kudu/127.14.15.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
Entry for principal kudu/127.14.15.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab.
I20260809 15:44:50.829624 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:50.943913 10499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:50.944200 10499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:50.944245 10499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:50.948256 10499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:50.948320 10499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:50.948379 10499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:50.953636 10499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.130.keytab
--principal=kudu/127.14.15.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:50.954806 10499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:50.955950 10499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:50.965813 10508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:50.965801 10510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:50.965804 10507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:50.966105 10499 server_base.cc:1034] running on GCE node
I20260809 15:44:50.966589 10499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:50.967243 10499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:50.968430 10499 hybrid_clock.cc:648] HybridClock initialized: now 1786290290968414 us; error 29 us; skew 500 ppm
Aug 09 15:44:50 dist-test-slave-jztv krb5kdc[10123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:50.971485 10499 init.cc:377] Logged in from keytab as kudu/127.14.15.130@KRBTEST.COM (short username kudu)
I20260809 15:44:50.972460 10499 webserver.cc:460] Webserver started at http://127.14.15.130:43975/ using document root <none> and password file <none>
I20260809 15:44:50.973054 10499 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:50.973151 10499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:50.973397 10499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:50.975514 10499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "2f2d1312489a43838bac986d92425c64"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "b5fd15255737004f494adf983e08ddfe"
server_key_iv: "6b05fb123854b043b5a4dee83b711ced"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.976106 10499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "2f2d1312489a43838bac986d92425c64"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "b5fd15255737004f494adf983e08ddfe"
server_key_iv: "6b05fb123854b043b5a4dee83b711ced"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.980118 10499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 15:44:50.982533 10521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:50.983839 10499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:44:50.983989 10499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "2f2d1312489a43838bac986d92425c64"
format_stamp: "Formatted at 2026-08-09 15:44:50 on dist-test-slave-jztv"
server_key: "b5fd15255737004f494adf983e08ddfe"
server_key_iv: "6b05fb123854b043b5a4dee83b711ced"
server_key_version: "encryptionkey@0"
I20260809 15:44:50.984114 10499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:50.995893 10499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:50.999224 10499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:50.999450 10499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:51.000051 10499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:51.000877 10499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:51.000949 10499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.001022 10499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:51.001070 10499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.010392 10499 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:39065
I20260809 15:44:51.010419 10695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:39065 every 8 connection(s)
I20260809 15:44:51.011267 10499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:51.016954 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 10499
I20260809 15:44:51.017107 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:51.017395 14398 external_mini_cluster.cc:1428] Setting key 9fd73f0f7d1d2a656360f5b21422f7d4
Aug 09 15:44:51 dist-test-slave-jztv krb5kdc[10123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.130@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:51.026573 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.013024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:42031 (local address 127.14.15.190:42919)
0809 15:44:51.013224 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.013228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.014052 (+ 824us) server_negotiation.cc:407] Connection header received
0809 15:44:51.015547 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.015550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.015613 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.015688 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:51.016924 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.017575 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.019103 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.019317 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.019406 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.022635 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:51.022641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:51.022647 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:51.022683 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:51.024212 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.024844 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.024847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.024848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.024921 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.025340 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.025343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.025344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.025513 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:51.025593 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.026341 (+ 748us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.026444 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:44:51.027777 10699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.013433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42919 (local address 127.14.15.130:42031)
0809 15:44:51.013902 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.013950 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.015322 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.015857 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.015863 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.016206 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:51.016762 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.016785 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.017711 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.017715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.018966 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.018979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.019499 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.019506 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.019730 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.020373 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:51.020399 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:51.022462 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:51.024328 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:51.024339 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:51.024359 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:51.024736 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:51.025015 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:51.025021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:51.025026 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:51.025235 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:51.025630 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:51.025638 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:51.026019 (+ 381us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.026295 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.026668 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for kudu/127.14.15.131@KRBTEST.COM; defaulting to no policy
I20260809 15:44:51.029022 10696 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42919
I20260809 15:44:51.029286 10696 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:51.029752 10696 heartbeater.cc:511] Master 127.14.15.190:42919 requested a full tablet report, sending...
I20260809 15:44:51.030858 10193 ts_manager.cc:194] Registered new tserver with Master: 2f2d1312489a43838bac986d92425c64 (127.14.15.130:39065)
I20260809 15:44:51.031524 10193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.130@KRBTEST.COM'} at 127.14.15.130:42031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
Entry for principal kudu/127.14.15.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab.
I20260809 15:44:51.049547 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:51.164142 10705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:51.164392 10705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:51.164435 10705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:51.168404 10705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:51.168459 10705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:51.168516 10705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:51.173908 10705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.131.keytab
--principal=kudu/127.14.15.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:42919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:51.174880 10705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:51.175812 10705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:51.185566 10714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:51.185592 10717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:51.185609 10715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:51.185747 10705 server_base.cc:1034] running on GCE node
I20260809 15:44:51.186321 10705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:51.186939 10705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:51.188151 10705 hybrid_clock.cc:648] HybridClock initialized: now 1786290291188134 us; error 30 us; skew 500 ppm
Aug 09 15:44:51 dist-test-slave-jztv krb5kdc[10123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290291, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:51.190948 10705 init.cc:377] Logged in from keytab as kudu/127.14.15.131@KRBTEST.COM (short username kudu)
I20260809 15:44:51.191748 10705 webserver.cc:460] Webserver started at http://127.14.15.131:41883/ using document root <none> and password file <none>
I20260809 15:44:51.192284 10705 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:51.192345 10705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:51.192512 10705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:51.194517 10705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "e7575af6069b422cb4eaf419fdd87985"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "14294d4b15acb14d87d63e4b6ae74ff5"
server_key_iv: "a35c196b289ed86f98158a16e9ea84de"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.195047 10705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "e7575af6069b422cb4eaf419fdd87985"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "14294d4b15acb14d87d63e4b6ae74ff5"
server_key_iv: "a35c196b289ed86f98158a16e9ea84de"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.198689 10705 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:51.201028 10725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.202328 10705 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:51.202454 10705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "e7575af6069b422cb4eaf419fdd87985"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "14294d4b15acb14d87d63e4b6ae74ff5"
server_key_iv: "a35c196b289ed86f98158a16e9ea84de"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.202564 10705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:51.219081 10705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:51.222638 10705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:51.222862 10705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:51.223495 10705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:51.224377 10705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:51.224431 10705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.224472 10705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:51.224514 10705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.233276 10705 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:45745
I20260809 15:44:51.233300 10896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:45745 every 8 connection(s)
I20260809 15:44:51.234246 10705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:51.237169 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 10705
I20260809 15:44:51.237299 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:51.237636 14398 external_mini_cluster.cc:1428] Setting key 3e0367613f869b67adfc146140cd65df
Aug 09 15:44:51 dist-test-slave-jztv krb5kdc[10123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290291, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.131@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:44:51.248775 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.236252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:44651 (local address 127.14.15.190:42919)
0809 15:44:51.236402 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.236405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.237215 (+ 810us) server_negotiation.cc:407] Connection header received
0809 15:44:51.238860 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.238863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.238934 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.239039 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:51.240365 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.240897 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.242065 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.242360 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.242476 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.245023 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:51.245027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:51.245030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:51.245063 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:51.246714 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.247242 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.247245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.247246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.247331 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.247727 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.247730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.247731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.247930 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:51.248011 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.248521 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.248649 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:44:51.249599 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.236616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:42919 (local address 127.14.15.131:44651)
0809 15:44:51.237063 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.237107 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.238652 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.239231 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.239238 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.239655 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:51.240217 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.240231 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.241038 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.241041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.241932 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.241942 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.242521 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.242526 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.242707 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.243336 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:44:51.243353 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:51.244851 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:51.246838 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:51.246842 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:51.246856 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:51.247140 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:51.247465 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:44:51.247469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:44:51.247470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:44:51.247621 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:44:51.248027 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:51.248032 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:51.248283 (+ 251us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.248467 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.248733 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":109,"threads_started":1}
I20260809 15:44:51.250828 10897 heartbeater.cc:347] Connected to a master server at 127.14.15.190:42919
I20260809 15:44:51.251066 10897 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:51.251583 10897 heartbeater.cc:511] Master 127.14.15.190:42919 requested a full tablet report, sending...
I20260809 15:44:51.252604 10193 ts_manager.cc:194] Registered new tserver with Master: e7575af6069b422cb4eaf419fdd87985 (127.14.15.131:45745)
I20260809 15:44:51.253168 10193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.15.131@KRBTEST.COM'} at 127.14.15.131:44651
I20260809 15:44:51.263487 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:51.272933 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.265483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55392 (local address 127.14.15.190:42919)
0809 15:44:51.265620 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.265623 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.265818 (+ 195us) server_negotiation.cc:407] Connection header received
0809 15:44:51.265904 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.265906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.265945 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.266012 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:51.266755 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.267263 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.268097 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.268322 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.268414 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.269752 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:51.269756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:51.269759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:51.269791 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:51.271333 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.271831 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.271835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.271837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.271936 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:51.272172 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:51.272174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:51.272175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:51.272386 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:51.272491 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.272708 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.272802 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:44:51.275929 10193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:51.279089 10193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:51.293355 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.287621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37495 (local address 127.0.0.1:49138)
0809 15:44:51.288421 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.288475 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.288607 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.289401 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.289406 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.289429 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:51.289593 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.289603 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.290779 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.290783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.291880 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.291893 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.292785 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.292789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.292903 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.292940 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.293079 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.293202 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260809 15:44:51.293363 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.287737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49138 (local address 127.14.15.129:37495)
0809 15:44:51.288649 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.288666 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.288691 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:44:51.288775 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.288802 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.289026 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.289185 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:51.289701 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.290640 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.292019 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.292655 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.292785 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.292941 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.293111 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.293209 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":135,"threads_started":1}
I20260809 15:44:51.294373 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.288470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:39065 (local address 127.0.0.1:42928)
0809 15:44:51.289429 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.289442 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.289558 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.289997 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.290000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.290020 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:51.290110 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.290116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.291501 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.291504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.292813 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.292825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.293949 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.293953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.294046 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.294071 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.294146 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.294245 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":73,"thread_start_us":100,"threads_started":1}
I20260809 15:44:51.295019 10922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.287942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55738 (local address 127.14.15.131:45745)
0809 15:44:51.288447 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.288461 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.289093 (+ 632us) server_negotiation.cc:407] Connection header received
0809 15:44:51.289278 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.289284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.289460 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.289601 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:51.290053 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.291255 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.292976 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.293819 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.293913 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.294060 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.294774 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.294871 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":147,"threads_started":1}
I20260809 15:44:51.295419 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.287746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45745 (local address 127.0.0.1:55738)
0809 15:44:51.288980 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.288992 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.289109 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.289778 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.289781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.289798 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:51.289900 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.289910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.291430 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.291434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.292813 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.292825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.294518 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.294521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.294611 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.294633 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.295222 (+ 589us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.295299 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1183,"mutex_wait_us":92,"thread_start_us":105,"threads_started":1}
I20260809 15:44:51.296602 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 06c9045b668844599e8d8691219e791f (DEFAULT_TABLE table=test-table [id=1620d987ac1a4b8f859de3430ab06a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:51.297580 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c9045b668844599e8d8691219e791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:51.294449 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.288903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42928 (local address 127.14.15.130:39065)
0809 15:44:51.289306 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.289318 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.289548 (+ 230us) server_negotiation.cc:407] Connection header received
0809 15:44:51.289667 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.289672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.289841 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.290002 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:51.290208 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.291348 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.292966 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.293819 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.293933 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.294060 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.294173 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.294285 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":126,"threads_started":1}
I20260809 15:44:51.300861 10796 tablet_service.cc:1467] Processing CreateTablet for tablet 06c9045b668844599e8d8691219e791f (DEFAULT_TABLE table=test-table [id=1620d987ac1a4b8f859de3430ab06a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:51.301115 10594 tablet_service.cc:1467] Processing CreateTablet for tablet 06c9045b668844599e8d8691219e791f (DEFAULT_TABLE table=test-table [id=1620d987ac1a4b8f859de3430ab06a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:51.301841 10796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c9045b668844599e8d8691219e791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:51.302130 10594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c9045b668844599e8d8691219e791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:51.305222 10929 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: Bootstrap starting.
I20260809 15:44:51.307737 10929 tablet_bootstrap.cc:654] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:51.308557 10930 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Bootstrap starting.
I20260809 15:44:51.308643 10929 log.cc:824] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:51.309716 10932 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Bootstrap starting.
I20260809 15:44:51.310820 10930 tablet_bootstrap.cc:654] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:51.311149 10929 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: No bootstrap required, opened a new log
I20260809 15:44:51.311353 10929 ts_tablet_manager.cc:1397] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 15:44:51.311944 10932 tablet_bootstrap.cc:654] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:51.312160 10930 log.cc:824] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:51.313163 10932 log.cc:824] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:51.314494 10930 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: No bootstrap required, opened a new log
I20260809 15:44:51.314734 10930 ts_tablet_manager.cc:1397] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:51.315196 10932 tablet_bootstrap.cc:492] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: No bootstrap required, opened a new log
I20260809 15:44:51.315374 10932 ts_tablet_manager.cc:1397] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:44:51.315762 10929 raft_consensus.cc:348] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.316260 10929 raft_consensus.cc:374] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:51.316386 10929 raft_consensus.cc:729] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b0ee89e0b4b86bcaa54e28d753087, State: Initialized, Role: FOLLOWER
I20260809 15:44:51.316947 10929 consensus_queue.cc:260] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.317663 10492 heartbeater.cc:503] Master 127.14.15.190:42919 was elected leader, sending a full tablet report...
I20260809 15:44:51.318002 10929 ts_tablet_manager.cc:1428] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 15:44:51.318753 10930 raft_consensus.cc:348] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.319072 10930 raft_consensus.cc:374] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:51.319162 10930 raft_consensus.cc:729] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7575af6069b422cb4eaf419fdd87985, State: Initialized, Role: FOLLOWER
I20260809 15:44:51.319340 10932 raft_consensus.cc:348] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.319603 10932 raft_consensus.cc:374] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:51.319707 10932 raft_consensus.cc:729] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f2d1312489a43838bac986d92425c64, State: Initialized, Role: FOLLOWER
I20260809 15:44:51.319689 10930 consensus_queue.cc:260] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.320147 10932 consensus_queue.cc:260] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.320403 10897 heartbeater.cc:503] Master 127.14.15.190:42919 was elected leader, sending a full tablet report...
I20260809 15:44:51.320712 10930 ts_tablet_manager.cc:1428] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:44:51.321208 10932 ts_tablet_manager.cc:1428] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:51.321749 10696 heartbeater.cc:503] Master 127.14.15.190:42919 was elected leader, sending a full tablet report...
I20260809 15:44:51.430446 10946 raft_consensus.cc:482] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:51.430727 10946 raft_consensus.cc:504] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.431957 10946 leader_election.cc:288] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b0ee89e0b4b86bcaa54e28d753087 (127.14.15.129:37495), e7575af6069b422cb4eaf419fdd87985 (127.14.15.131:45745)
I20260809 15:44:51.436028 10922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.432364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:36975 (local address 127.14.15.131:45745)
0809 15:44:51.432514 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.432518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.432786 (+ 268us) server_negotiation.cc:407] Connection header received
0809 15:44:51.432920 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.432924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.432978 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.433060 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:51.433371 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.433879 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435031 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.435437 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435573 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.435629 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.435807 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.435891 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:44:51.436049 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.432297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:53953 (local address 127.14.15.129:37495)
0809 15:44:51.432452 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.432458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.432658 (+ 200us) server_negotiation.cc:407] Connection header received
0809 15:44:51.432767 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.432771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.432828 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.432908 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:51.433241 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.433814 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435036 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.435446 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435582 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.435638 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.435857 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.435933 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:44:51.436072 10947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.432262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:45745 (local address 127.14.15.130:36975)
0809 15:44:51.432666 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.432681 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.432791 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.433096 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.433098 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.433114 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:51.433253 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.433260 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.434003 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.434005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.434907 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.434916 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.435562 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.435670 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.435702 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.435766 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.435905 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":68,"thread_start_us":168,"threads_started":1}
I20260809 15:44:51.436075 10699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.432164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37495 (local address 127.14.15.130:53953)
0809 15:44:51.432558 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.432579 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:51.432670 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:51.432940 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:51.432943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:51.432958 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:51.433114 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.433122 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.433938 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.433945 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.434905 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:51.434916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.435596 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.435599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:51.435710 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.435727 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:44:51.435821 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:44:51.435959 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":94}
I20260809 15:44:51.436846 10425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c9045b668844599e8d8691219e791f" candidate_uuid: "2f2d1312489a43838bac986d92425c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" is_pre_election: true
I20260809 15:44:51.436861 10832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c9045b668844599e8d8691219e791f" candidate_uuid: "2f2d1312489a43838bac986d92425c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7575af6069b422cb4eaf419fdd87985" is_pre_election: true
I20260809 15:44:51.437201 10425 raft_consensus.cc:2454] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f2d1312489a43838bac986d92425c64 in term 0.
I20260809 15:44:51.437198 10832 raft_consensus.cc:2454] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f2d1312489a43838bac986d92425c64 in term 0.
I20260809 15:44:51.437697 10525 leader_election.cc:302] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2d1312489a43838bac986d92425c64, e7575af6069b422cb4eaf419fdd87985; no voters:
I20260809 15:44:51.438011 10946 raft_consensus.cc:2781] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:51.438097 10946 raft_consensus.cc:482] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:51.438128 10946 raft_consensus.cc:3037] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:51.439229 10946 raft_consensus.cc:504] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.439639 10946 leader_election.cc:288] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [CANDIDATE]: Term 1 election: Requested vote from peers f15b0ee89e0b4b86bcaa54e28d753087 (127.14.15.129:37495), e7575af6069b422cb4eaf419fdd87985 (127.14.15.131:45745)
I20260809 15:44:51.439965 10425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c9045b668844599e8d8691219e791f" candidate_uuid: "2f2d1312489a43838bac986d92425c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b0ee89e0b4b86bcaa54e28d753087"
I20260809 15:44:51.440039 10832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c9045b668844599e8d8691219e791f" candidate_uuid: "2f2d1312489a43838bac986d92425c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7575af6069b422cb4eaf419fdd87985"
I20260809 15:44:51.440105 10425 raft_consensus.cc:3037] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:51.440173 10832 raft_consensus.cc:3037] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:51.441154 10425 raft_consensus.cc:2454] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f2d1312489a43838bac986d92425c64 in term 1.
I20260809 15:44:51.441231 10832 raft_consensus.cc:2454] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f2d1312489a43838bac986d92425c64 in term 1.
I20260809 15:44:51.441510 10523 leader_election.cc:302] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2d1312489a43838bac986d92425c64, f15b0ee89e0b4b86bcaa54e28d753087; no voters:
I20260809 15:44:51.441685 10946 raft_consensus.cc:2781] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:51.441939 10946 raft_consensus.cc:686] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 1 LEADER]: Becoming Leader. State: Replica: 2f2d1312489a43838bac986d92425c64, State: Running, Role: LEADER
I20260809 15:44:51.442333 10946 consensus_queue.cc:237] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } }
I20260809 15:44:51.445485 10193 catalog_manager.cc:5495] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f2d1312489a43838bac986d92425c64 (127.14.15.130). New cstate: current_term: 1 leader_uuid: "2f2d1312489a43838bac986d92425c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f2d1312489a43838bac986d92425c64" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 39065 } health_report { overall_health: HEALTHY } } }
I20260809 15:44:51.482646 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.479058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.14.15.130:39065)
0809 15:44:51.479221 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.479225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.479240 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:44:51.479399 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.479401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.479461 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.479561 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:51.479816 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.480316 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.481194 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.481394 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.481471 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.481756 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:51.482181 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:51.482347 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.482405 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.482455 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 15:44:51.485332 10902 tablet.cc:2369] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:51.488822 10425 raft_consensus.cc:1261] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087 [term 1 FOLLOWER]: Refusing update from remote peer 2f2d1312489a43838bac986d92425c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:51.488821 10832 raft_consensus.cc:1261] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 1 FOLLOWER]: Refusing update from remote peer 2f2d1312489a43838bac986d92425c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:51.489555 10948 consensus_queue.cc:1035] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b0ee89e0b4b86bcaa54e28d753087" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:51.489755 10946 consensus_queue.cc:1035] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7575af6069b422cb4eaf419fdd87985" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:51.500978 10954 mvcc.cc:205] Tried to move back new op lower bound from 7316645033930526720 to 7316645033750396928. Current Snapshot: MvccSnapshot[applied={T|T < 7316645033930526720}]
I20260809 15:44:51.505741 10956 mvcc.cc:205] Tried to move back new op lower bound from 7316645033930526720 to 7316645033750396928. Current Snapshot: MvccSnapshot[applied={T|T < 7316645033930526720 or (T in {7316645033930526720})}]
I20260809 15:44:51.508178 10192 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:51.508347 10192 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:51.510692 10192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 942cc0c665094b5dbeb4fa41b0684abe: Sending DeleteTablet for 3 replicas of tablet 06c9045b668844599e8d8691219e791f
I20260809 15:44:51.511451 10796 tablet_service.cc:1514] Processing DeleteTablet for tablet 06c9045b668844599e8d8691219e791f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:51 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:55738
I20260809 15:44:51.511656 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet 06c9045b668844599e8d8691219e791f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:51 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:49138
I20260809 15:44:51.512126 10594 tablet_service.cc:1514] Processing DeleteTablet for tablet 06c9045b668844599e8d8691219e791f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:51 UTC) from {username='kudu', principal='kudu/127.14.15.190@KRBTEST.COM'} at 127.0.0.1:42928
I20260809 15:44:51.512305 10967 tablet_replica.cc:330] T 06c9045b668844599e8d8691219e791f P f15b0ee89e0b4b86bcaa54e28d753087: stopping tablet replica
I20260809 15:44:51.512388 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 10284
I20260809 15:44:51.515218 10968 tablet_replica.cc:330] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: stopping tablet replica
I20260809 15:44:51.515578 10968 raft_consensus.cc:2229] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:51.515969 10968 raft_consensus.cc:2258] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:51.518244 10968 ts_tablet_manager.cc:1905] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:51.519942 10964 tablet_replica.cc:330] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: stopping tablet replica
I20260809 15:44:51.520295 10964 raft_consensus.cc:2229] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:51.520648 10964 raft_consensus.cc:2258] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:51.521778 10968 ts_tablet_manager.cc:1918] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:51.521931 10968 log.cc:1196] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/06c9045b668844599e8d8691219e791f
I20260809 15:44:51.522276 10964 ts_tablet_manager.cc:1905] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:51.522434 10968 ts_tablet_manager.cc:1939] T 06c9045b668844599e8d8691219e791f P 2f2d1312489a43838bac986d92425c64: Deleting consensus metadata
I20260809 15:44:51.523742 10175 catalog_manager.cc:4841] TS 2f2d1312489a43838bac986d92425c64 (127.14.15.130:39065): tablet 06c9045b668844599e8d8691219e791f (table test-table [id=1620d987ac1a4b8f859de3430ab06a58]) successfully deleted
I20260809 15:44:51.524740 10964 ts_tablet_manager.cc:1918] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:51.524863 10964 log.cc:1196] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/06c9045b668844599e8d8691219e791f
I20260809 15:44:51.525170 10964 ts_tablet_manager.cc:1939] T 06c9045b668844599e8d8691219e791f P e7575af6069b422cb4eaf419fdd87985: Deleting consensus metadata
I20260809 15:44:51.526257 10176 catalog_manager.cc:4841] TS e7575af6069b422cb4eaf419fdd87985 (127.14.15.131:45745): tablet 06c9045b668844599e8d8691219e791f (table test-table [id=1620d987ac1a4b8f859de3430ab06a58]) successfully deleted
W20260809 15:44:51.531333 10173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:37495 (error 108)
I20260809 15:44:51.531587 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 10499
I20260809 15:44:51.539534 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.539109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:37495 (local address 127.0.0.1:49142)
0809 15:44:51.539292 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:51.539406 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 15:44:51.539754 10173 catalog_manager.cc:4584] TS f15b0ee89e0b4b86bcaa54e28d753087 (127.14.15.129:37495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 06c9045b668844599e8d8691219e791f: Network error: Client connection negotiation failed: client connection to 127.14.15.129:37495: connect: Connection refused (error 111)
I20260809 15:44:51.545396 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 10705
I20260809 15:44:51.557196 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 10143
2026-08-09T15:44:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2611 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T15:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:51Z Disabled control of system clock
I20260809 15:44:51.595723 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36029
--webserver_interface=127.14.15.190
--webserver_port=0
--builtin_ntp_servers=127.14.15.148:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:36029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:51.709227 10977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:51.709478 10977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:51.709513 10977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:51.713445 10977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:51.713502 10977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:51.713518 10977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:51.713536 10977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:51.713549 10977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:51.718120 10977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:36029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:51.719194 10977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:51.720577 10977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:51.729213 10984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:51.729203 10989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:51.729228 10982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:51.729465 10977 server_base.cc:1034] running on GCE node
I20260809 15:44:51.730149 10977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:51.731285 10977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:51.732448 10977 hybrid_clock.cc:648] HybridClock initialized: now 1786290291732434 us; error 25 us; skew 500 ppm
I20260809 15:44:51.734977 10977 webserver.cc:460] Webserver started at http://127.14.15.190:35613/ using document root <none> and password file <none>
I20260809 15:44:51.735743 10977 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:51.735841 10977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:51.736114 10977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:51.738472 10977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "84402337ed2042cb91f6dd967e4c50f4"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "2616bd70165c51344b7df503e3eb2a14"
server_key_iv: "e706cf22165e1616d82af7c53ce11324"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.739018 10977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "84402337ed2042cb91f6dd967e4c50f4"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "2616bd70165c51344b7df503e3eb2a14"
server_key_iv: "e706cf22165e1616d82af7c53ce11324"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.742781 10977 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:44:51.745206 10998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:51.746548 10977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:51.746677 10977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "84402337ed2042cb91f6dd967e4c50f4"
format_stamp: "Formatted at 2026-08-09 15:44:51 on dist-test-slave-jztv"
server_key: "2616bd70165c51344b7df503e3eb2a14"
server_key_iv: "e706cf22165e1616d82af7c53ce11324"
server_key_version: "encryptionkey@0"
I20260809 15:44:51.746799 10977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:51.778774 10977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:51.779495 10977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:51.779701 10977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:51.787460 10977 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:36029
I20260809 15:44:51.787480 11080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:36029 every 8 connection(s)
I20260809 15:44:51.788389 10977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:51.791415 11083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:51.792003 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 10977
I20260809 15:44:51.792132 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:51.792454 14398 external_mini_cluster.cc:1428] Setting key 0c3c975a3c767b1e6157df29c9c1003e
I20260809 15:44:51.798280 11083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: Bootstrap starting.
I20260809 15:44:51.800925 11083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:51.801875 11083 log.cc:824] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:51.803386 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:51.793857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.14.15.190:36029)
0809 15:44:51.794577 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:51.794599 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:51.794647 (+ 48us) server_negotiation.cc:407] Connection header received
0809 15:44:51.795500 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:51.795524 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:51.796014 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:51.796407 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:51.796848 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.798351 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.799443 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:51.800140 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:51.800304 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:51.801271 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:51.801277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:51.801295 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:51.801803 (+ 508us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:51.801874 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:51.801904 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:51.802011 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:51.802195 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 15:44:51.802508 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":111,"threads_started":1}
I20260809 15:44:51.804220 11083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: No bootstrap required, opened a new log
I20260809 15:44:51.808262 11083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } }
I20260809 15:44:51.808517 11083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:51.808609 11083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84402337ed2042cb91f6dd967e4c50f4, State: Initialized, Role: FOLLOWER
I20260809 15:44:51.809046 11083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } }
I20260809 15:44:51.809201 11083 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:51.809293 11083 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:51.809392 11083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:51.810518 11083 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } }
I20260809 15:44:51.810863 11083 leader_election.cc:302] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84402337ed2042cb91f6dd967e4c50f4; no voters:
I20260809 15:44:51.811220 11083 leader_election.cc:288] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:51.811372 11089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:51.811636 11089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [term 1 LEADER]: Becoming Leader. State: Replica: 84402337ed2042cb91f6dd967e4c50f4, State: Running, Role: LEADER
I20260809 15:44:51.811942 11089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } }
I20260809 15:44:51.812505 11083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:51.813809 11094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84402337ed2042cb91f6dd967e4c50f4. Latest consensus state: current_term: 1 leader_uuid: "84402337ed2042cb91f6dd967e4c50f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } } }
I20260809 15:44:51.813807 11090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84402337ed2042cb91f6dd967e4c50f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84402337ed2042cb91f6dd967e4c50f4" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36029 } } }
I20260809 15:44:51.813978 11094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:51.813999 11090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:51.814474 11102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:51.817097 11102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:51.822700 11102 catalog_manager.cc:1347] Generated new cluster ID: adbfb0bf80394185a6c6a42a5c467434
I20260809 15:44:51.822795 11102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:51.860705 11102 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:51.861650 11102 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:51.868257 11102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: Generated new TSK 0
I20260809 15:44:51.869004 11102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:51.882345 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.129:0
--local_ip_for_outbound_sockets=127.14.15.129
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--builtin_ntp_servers=127.14.15.148:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:44:52.002964 11116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:52.003265 11116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:52.003309 11116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:52.007454 11116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:52.007519 11116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:52.007575 11116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.129
I20260809 15:44:52.012681 11116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.15.129
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.129
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:52.013976 11116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:52.015475 11116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:52.025704 11128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:52.025695 11127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:52.025861 11116 server_base.cc:1034] running on GCE node
W20260809 15:44:52.025695 11131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:52.026576 11116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:52.027266 11116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:52.028489 11116 hybrid_clock.cc:648] HybridClock initialized: now 1786290292028470 us; error 32 us; skew 500 ppm
I20260809 15:44:52.030529 11116 webserver.cc:460] Webserver started at http://127.14.15.129:37491/ using document root <none> and password file <none>
I20260809 15:44:52.031162 11116 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:52.031270 11116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:52.031524 11116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:52.033743 11116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data/instance:
uuid: "b1ddf6d26973403b9ef999cab65bf352"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "83e5d24be921afd70f97055763019569"
server_key_iv: "47a50b5d184b6652988ef53662d47b61"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.034343 11116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance:
uuid: "b1ddf6d26973403b9ef999cab65bf352"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "83e5d24be921afd70f97055763019569"
server_key_iv: "47a50b5d184b6652988ef53662d47b61"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.038074 11116 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:44:52.040695 11137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.042274 11116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:44:52.042393 11116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal
uuid: "b1ddf6d26973403b9ef999cab65bf352"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "83e5d24be921afd70f97055763019569"
server_key_iv: "47a50b5d184b6652988ef53662d47b61"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.042503 11116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:52.064879 11116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:52.065593 11116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:52.065757 11116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:52.066386 11116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:52.067363 11116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:52.067411 11116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.067461 11116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:52.067478 11116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.079244 11116 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.129:45381
I20260809 15:44:52.079270 11322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.129:45381 every 8 connection(s)
I20260809 15:44:52.080209 11116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/data/info.pb
I20260809 15:44:52.080456 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 11116
I20260809 15:44:52.080627 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-0/wal/instance
I20260809 15:44:52.081013 14398 external_mini_cluster.cc:1428] Setting key a9cff861c30b85fd25bd2f7d492bbf43
I20260809 15:44:52.083511 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.130:0
--local_ip_for_outbound_sockets=127.14.15.130
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--builtin_ntp_servers=127.14.15.148:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:52.090770 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.082276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:56665 (local address 127.14.15.190:36029)
0809 15:44:52.082418 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.082423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.083733 (+ 1310us) server_negotiation.cc:407] Connection header received
0809 15:44:52.085351 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.085354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.085421 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.085498 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:52.086784 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.087343 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.088724 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.088954 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.089071 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.090236 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:52.090240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:52.090243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:52.090266 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:52.090286 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:52.090295 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:52.090374 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.090545 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.090618 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:44:52.091642 11325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.082841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36029 (local address 127.14.15.129:56665)
0809 15:44:52.083552 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.083623 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.085081 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.085715 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.085726 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.085837 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:52.086606 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.086631 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.087510 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.087515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.088593 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.088604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.089115 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.089119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.089292 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.089945 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:52.089946 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:52.089989 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:52.090056 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:52.090389 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:52.090401 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:52.090409 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.090545 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.090828 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":139,"threads_started":1}
I20260809 15:44:52.093165 11323 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36029
I20260809 15:44:52.093468 11323 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:52.094026 11323 heartbeater.cc:511] Master 127.14.15.190:36029 requested a full tablet report, sending...
I20260809 15:44:52.095901 11021 ts_manager.cc:194] Registered new tserver with Master: b1ddf6d26973403b9ef999cab65bf352 (127.14.15.129:45381)
I20260809 15:44:52.097519 11021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.129:56665
W20260809 15:44:52.208987 11326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:52.209280 11326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:52.209321 11326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:52.213580 11326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:52.213667 11326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:52.213800 11326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.130
I20260809 15:44:52.218868 11326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.15.130
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.130
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:52.219978 11326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:52.221341 11326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:52.231432 11339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:52.231427 11341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:52.231686 11326 server_base.cc:1034] running on GCE node
W20260809 15:44:52.231429 11335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:52.232197 11326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:52.232872 11326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:52.234069 11326 hybrid_clock.cc:648] HybridClock initialized: now 1786290292234051 us; error 29 us; skew 500 ppm
I20260809 15:44:52.236076 11326 webserver.cc:460] Webserver started at http://127.14.15.130:38713/ using document root <none> and password file <none>
I20260809 15:44:52.236692 11326 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:52.236789 11326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:52.237025 11326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:52.239174 11326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data/instance:
uuid: "47f7af31438541eb809c8590d25bd054"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "fff2f595223333768ec31bf7a90a22fc"
server_key_iv: "a8cbb7ebfbb80333ce6dbab19283ba32"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.239769 11326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance:
uuid: "47f7af31438541eb809c8590d25bd054"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "fff2f595223333768ec31bf7a90a22fc"
server_key_iv: "a8cbb7ebfbb80333ce6dbab19283ba32"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.243572 11326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:44:52.246034 11349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.247318 11326 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:52.247463 11326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal
uuid: "47f7af31438541eb809c8590d25bd054"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "fff2f595223333768ec31bf7a90a22fc"
server_key_iv: "a8cbb7ebfbb80333ce6dbab19283ba32"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.247583 11326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:52.261320 11326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:52.261963 11326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:52.262154 11326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:52.262770 11326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:52.263702 11326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:52.263772 11326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.263837 11326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:52.263885 11326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.272397 11326 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.130:40133
I20260809 15:44:52.272481 11542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.130:40133 every 8 connection(s)
I20260809 15:44:52.273307 11326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/data/info.pb
I20260809 15:44:52.282140 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 11326
I20260809 15:44:52.282330 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal/instance
I20260809 15:44:52.282737 14398 external_mini_cluster.cc:1428] Setting key d5d8dfbf0819195ca4e931dd832008d6
I20260809 15:44:52.283479 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.275306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.130:56173 (local address 127.14.15.190:36029)
0809 15:44:52.275458 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.275463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.276478 (+ 1015us) server_negotiation.cc:407] Connection header received
0809 15:44:52.277962 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.277966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.278035 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.278137 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:52.279115 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.279671 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.280861 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.281088 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.281202 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.282757 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:52.282760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:52.282762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:52.282818 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:52.282845 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:52.282856 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:52.282964 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.283157 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.283254 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:44:52.284795 11550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.275580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36029 (local address 127.14.15.130:56173)
0809 15:44:52.276275 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.276318 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.277725 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.278356 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.278371 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.278458 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:52.278950 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.278962 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.279813 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.279817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.280726 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.280736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.281255 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.281259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.281434 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.282173 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:52.282175 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:52.282353 (+ 178us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:52.282519 (+ 166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:52.282967 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:52.282996 (+ 29us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:52.283005 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.283157 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.283465 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":111,"threads_started":1}
I20260809 15:44:52.285167 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.15.131:0
--local_ip_for_outbound_sockets=127.14.15.131
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--builtin_ntp_servers=127.14.15.148:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:44:52.288784 11543 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36029
I20260809 15:44:52.289054 11543 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:52.289865 11543 heartbeater.cc:511] Master 127.14.15.190:36029 requested a full tablet report, sending...
I20260809 15:44:52.291281 11021 ts_manager.cc:194] Registered new tserver with Master: 47f7af31438541eb809c8590d25bd054 (127.14.15.130:40133)
I20260809 15:44:52.292205 11021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.130:56173
W20260809 15:44:52.402125 11551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:52.402429 11551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:52.402470 11551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:52.406387 11551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:52.406446 11551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:52.406499 11551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.15.131
I20260809 15:44:52.411083 11551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.15.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.15.131
--webserver_port=0
--tserver_master_addrs=127.14.15.190:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.15.131
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:52.412103 11551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:52.413518 11551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:52.423645 11560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:52.423679 11561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:52.423645 11564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:52.423882 11551 server_base.cc:1034] running on GCE node
I20260809 15:44:52.424430 11551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:52.425047 11551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:52.426288 11551 hybrid_clock.cc:648] HybridClock initialized: now 1786290292426271 us; error 27 us; skew 500 ppm
I20260809 15:44:52.428354 11551 webserver.cc:460] Webserver started at http://127.14.15.131:43165/ using document root <none> and password file <none>
I20260809 15:44:52.428946 11551 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:52.429040 11551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:52.429279 11551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:52.431484 11551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data/instance:
uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "ef10f217029d77917d3ee8c5ea4892ef"
server_key_iv: "9ce14f2fbcdee44556e38441878cf0e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.432073 11551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance:
uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "ef10f217029d77917d3ee8c5ea4892ef"
server_key_iv: "9ce14f2fbcdee44556e38441878cf0e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.435947 11551 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:44:52.438752 11573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.440006 11551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:44:52.440162 11551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal
uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b"
format_stamp: "Formatted at 2026-08-09 15:44:52 on dist-test-slave-jztv"
server_key: "ef10f217029d77917d3ee8c5ea4892ef"
server_key_iv: "9ce14f2fbcdee44556e38441878cf0e6"
server_key_version: "encryptionkey@0"
I20260809 15:44:52.440287 11551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:52.461033 11551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:52.461782 11551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:52.461995 11551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:52.462653 11551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:44:52.463637 11551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:44:52.463714 11551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.463790 11551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:44:52.463835 11551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:52.473049 11551 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.131:40917
I20260809 15:44:52.473073 11756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.131:40917 every 8 connection(s)
I20260809 15:44:52.473976 11551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/data/info.pb
I20260809 15:44:52.474841 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 11551
I20260809 15:44:52.474974 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal/instance
I20260809 15:44:52.475281 14398 external_mini_cluster.cc:1428] Setting key c53ad83d28b75dbb5714c2efc062b8c5
I20260809 15:44:52.484243 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.476088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.131:55989 (local address 127.14.15.190:36029)
0809 15:44:52.476228 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.476233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.477545 (+ 1312us) server_negotiation.cc:407] Connection header received
0809 15:44:52.479130 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.479133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.479191 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.479275 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:52.480263 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.480849 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.482147 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.482501 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.482601 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.483814 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:52.483817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:52.483819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:52.483832 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:52.483851 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:52.483859 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:52.483924 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.484071 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.484127 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:44:52.485114 11761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.476607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:36029 (local address 127.14.15.131:55989)
0809 15:44:52.477392 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.477448 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.478906 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.479494 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.479501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.479589 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:44:52.480110 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.480123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.480984 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.480987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.482020 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.482031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.482658 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.482662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.482830 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.483521 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:44:52.483522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:44:52.483570 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:44:52.483636 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:44:52.483940 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:44:52.483947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:44:52.483952 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.484053 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.484278 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":159,"threads_started":1}
I20260809 15:44:52.486330 11757 heartbeater.cc:347] Connected to a master server at 127.14.15.190:36029
I20260809 15:44:52.486639 11757 heartbeater.cc:464] Registering TS with master...
I20260809 15:44:52.487182 11757 heartbeater.cc:511] Master 127.14.15.190:36029 requested a full tablet report, sending...
I20260809 15:44:52.488302 11021 ts_manager.cc:194] Registered new tserver with Master: 5a6ab021120a48e1aa7b9cd36c86ba4b (127.14.15.131:40917)
I20260809 15:44:52.489018 11021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.15.131:55989
I20260809 15:44:52.489404 14398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:44:52.495093 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.491687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.14.15.190:36029)
0809 15:44:52.491819 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.491828 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.492003 (+ 175us) server_negotiation.cc:407] Connection header received
0809 15:44:52.492082 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.492084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.492120 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.492185 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:52.492458 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.492939 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.493728 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.493927 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.494003 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.494773 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:52.494776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:52.494778 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:52.494789 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:52.494808 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:52.494815 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:52.494875 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.494949 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.494993 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:44:52.497771 11021 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51546:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:44:52.500769 11021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:44:52.515450 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.509796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40917 (local address 127.0.0.1:44436)
0809 15:44:52.510022 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.510036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.510117 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.511093 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.511095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.511127 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:52.511241 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.511248 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512650 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.512655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.513751 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.513764 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.514860 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514867 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.514976 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515015 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.515134 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.515278 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":22,"spinlock_wait_cycles":768,"thread_start_us":94,"threads_started":1}
I20260809 15:44:52.515470 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.510249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44436 (local address 127.14.15.131:40917)
0809 15:44:52.510688 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.510699 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.510720 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:44:52.510791 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.510799 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.510959 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.511108 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:52.511379 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512544 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.513863 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.514726 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514844 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515053 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.515161 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.515263 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":151,"threads_started":1}
I20260809 15:44:52.515827 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.509880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.14.15.130:40133)
0809 15:44:52.510429 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.510441 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.510467 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:44:52.510544 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.510551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.510735 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.510887 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:52.511362 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512160 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514083 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.514807 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514914 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515114 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.515544 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.515662 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":149,"threads_started":1}
I20260809 15:44:52.516024 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.509296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.14.15.129:45381)
0809 15:44:52.510005 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.510017 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.510047 (+ 30us) server_negotiation.cc:407] Connection header received
0809 15:44:52.510132 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.510141 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.510413 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.510963 (+ 550us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:52.511121 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512381 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514056 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.514863 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.514972 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515127 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.515752 (+ 625us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.515843 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":136,"threads_started":1}
I20260809 15:44:52.515669 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.509096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45381 (local address 127.0.0.1:56486)
0809 15:44:52.509715 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.509731 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.509808 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.510594 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.510600 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.510626 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:52.510781 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.510790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512490 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.512493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.513924 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.513936 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.515191 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.515195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.515338 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515370 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.515446 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.515530 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":131,"thread_start_us":99,"threads_started":1}
I20260809 15:44:52.516225 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.509054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40133 (local address 127.0.0.1:49806)
0809 15:44:52.509482 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.509535 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.509670 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.511048 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.511052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.511075 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:52.511228 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.511239 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.512272 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.512278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.513931 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.513937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.515177 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.515181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.515306 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.515330 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.515397 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.515457 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":183,"spinlock_wait_cycles":1280,"thread_start_us":97,"threads_started":1}
I20260809 15:44:52.519500 11437 tablet_service.cc:1467] Processing CreateTablet for tablet 1de2452e2ee54231b39fce4171e651bb (DEFAULT_TABLE table=test-table [id=54a164543b49413b9e3c9c919a7f1bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:52.519542 11210 tablet_service.cc:1467] Processing CreateTablet for tablet 1de2452e2ee54231b39fce4171e651bb (DEFAULT_TABLE table=test-table [id=54a164543b49413b9e3c9c919a7f1bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:52.519542 11648 tablet_service.cc:1467] Processing CreateTablet for tablet 1de2452e2ee54231b39fce4171e651bb (DEFAULT_TABLE table=test-table [id=54a164543b49413b9e3c9c919a7f1bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:44:52.520551 11437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de2452e2ee54231b39fce4171e651bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:52.520596 11210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de2452e2ee54231b39fce4171e651bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:52.520596 11648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de2452e2ee54231b39fce4171e651bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:52.528017 11787 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Bootstrap starting.
I20260809 15:44:52.528510 11790 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Bootstrap starting.
I20260809 15:44:52.528765 11789 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Bootstrap starting.
I20260809 15:44:52.530448 11790 tablet_bootstrap.cc:654] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:52.530558 11787 tablet_bootstrap.cc:654] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:52.530679 11789 tablet_bootstrap.cc:654] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:52.531293 11790 log.cc:824] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:52.531424 11787 log.cc:824] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:52.531425 11789 log.cc:824] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:52.533485 11789 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: No bootstrap required, opened a new log
I20260809 15:44:52.533495 11790 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: No bootstrap required, opened a new log
I20260809 15:44:52.533504 11787 tablet_bootstrap.cc:492] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: No bootstrap required, opened a new log
I20260809 15:44:52.533685 11789 ts_tablet_manager.cc:1397] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:44:52.533685 11790 ts_tablet_manager.cc:1397] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 15:44:52.533691 11787 ts_tablet_manager.cc:1397] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:44:52.537088 11787 raft_consensus.cc:348] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.537302 11787 raft_consensus.cc:374] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:52.537340 11787 raft_consensus.cc:729] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f7af31438541eb809c8590d25bd054, State: Initialized, Role: FOLLOWER
I20260809 15:44:52.537791 11787 consensus_queue.cc:260] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.538062 11790 raft_consensus.cc:348] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.538062 11789 raft_consensus.cc:348] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.538345 11790 raft_consensus.cc:374] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:52.538345 11789 raft_consensus.cc:374] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:52.538414 11789 raft_consensus.cc:729] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a6ab021120a48e1aa7b9cd36c86ba4b, State: Initialized, Role: FOLLOWER
I20260809 15:44:52.538414 11790 raft_consensus.cc:729] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1ddf6d26973403b9ef999cab65bf352, State: Initialized, Role: FOLLOWER
I20260809 15:44:52.538729 11543 heartbeater.cc:503] Master 127.14.15.190:36029 was elected leader, sending a full tablet report...
I20260809 15:44:52.538872 11790 consensus_queue.cc:260] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.538863 11789 consensus_queue.cc:260] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.538978 11787 ts_tablet_manager.cc:1428] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:44:52.539542 11757 heartbeater.cc:503] Master 127.14.15.190:36029 was elected leader, sending a full tablet report...
I20260809 15:44:52.539763 11323 heartbeater.cc:503] Master 127.14.15.190:36029 was elected leader, sending a full tablet report...
I20260809 15:44:52.539816 11789 ts_tablet_manager.cc:1428] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:44:52.540872 11790 ts_tablet_manager.cc:1428] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260809 15:44:52.581656 11324 tablet.cc:2369] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:44:52.626677 11803 raft_consensus.cc:482] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:44:52.626904 11803 raft_consensus.cc:504] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.628028 11803 leader_election.cc:288] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f7af31438541eb809c8590d25bd054 (127.14.15.130:40133), 5a6ab021120a48e1aa7b9cd36c86ba4b (127.14.15.131:40917)
I20260809 15:44:52.632344 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.628449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:51295 (local address 127.14.15.130:40133)
0809 15:44:52.628631 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.628636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.628678 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:44:52.629029 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.629032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.629099 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.629183 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:52.629526 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.630139 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.631390 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.631765 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.631860 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.631901 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.632129 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.632219 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:44:52.632349 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.628340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.130:40133 (local address 127.14.15.129:51295)
0809 15:44:52.628605 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.628620 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.628738 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.629195 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.629198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.629243 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:52.629382 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.629392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.630284 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.630288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.631196 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.631206 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.631891 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.631898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.631998 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.632022 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.632096 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.632162 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":21,"thread_start_us":111,"threads_started":1}
I20260809 15:44:52.632474 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.628898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.15.129:38543 (local address 127.14.15.131:40917)
0809 15:44:52.629057 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.629060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.629126 (+ 66us) server_negotiation.cc:407] Connection header received
0809 15:44:52.629290 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.629294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.629343 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.629439 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:44:52.629745 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.630284 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.631365 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.631853 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.631986 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.632034 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.632255 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.632326 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:44:52.632428 11805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.628749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.131:40917 (local address 127.14.15.129:38543)
0809 15:44:52.629040 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.629055 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:44:52.629166 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:44:52.629479 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:44:52.629483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:44:52.629506 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:44:52.629628 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.629635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.630416 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.630419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.631224 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:44:52.631232 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.632005 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.632007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:44:52.632121 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.632146 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:44:52.632220 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 15:44:52.632286 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260809 15:44:52.633376 11465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de2452e2ee54231b39fce4171e651bb" candidate_uuid: "b1ddf6d26973403b9ef999cab65bf352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7af31438541eb809c8590d25bd054" is_pre_election: true
I20260809 15:44:52.633458 11682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de2452e2ee54231b39fce4171e651bb" candidate_uuid: "b1ddf6d26973403b9ef999cab65bf352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" is_pre_election: true
I20260809 15:44:52.633754 11465 raft_consensus.cc:2454] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1ddf6d26973403b9ef999cab65bf352 in term 0.
I20260809 15:44:52.633776 11682 raft_consensus.cc:2454] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1ddf6d26973403b9ef999cab65bf352 in term 0.
I20260809 15:44:52.634279 11143 leader_election.cc:302] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f7af31438541eb809c8590d25bd054, b1ddf6d26973403b9ef999cab65bf352; no voters:
I20260809 15:44:52.634590 11803 raft_consensus.cc:2781] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:44:52.634670 11803 raft_consensus.cc:482] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:44:52.634699 11803 raft_consensus.cc:3037] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:52.635761 11803 raft_consensus.cc:504] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.636111 11803 leader_election.cc:288] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [CANDIDATE]: Term 1 election: Requested vote from peers 47f7af31438541eb809c8590d25bd054 (127.14.15.130:40133), 5a6ab021120a48e1aa7b9cd36c86ba4b (127.14.15.131:40917)
I20260809 15:44:52.636523 11465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de2452e2ee54231b39fce4171e651bb" candidate_uuid: "b1ddf6d26973403b9ef999cab65bf352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7af31438541eb809c8590d25bd054"
I20260809 15:44:52.636565 11682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de2452e2ee54231b39fce4171e651bb" candidate_uuid: "b1ddf6d26973403b9ef999cab65bf352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b"
I20260809 15:44:52.636694 11682 raft_consensus.cc:3037] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:52.636693 11465 raft_consensus.cc:3037] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:52.637717 11465 raft_consensus.cc:2454] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1ddf6d26973403b9ef999cab65bf352 in term 1.
I20260809 15:44:52.637732 11682 raft_consensus.cc:2454] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1ddf6d26973403b9ef999cab65bf352 in term 1.
I20260809 15:44:52.638012 11143 leader_election.cc:302] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f7af31438541eb809c8590d25bd054, b1ddf6d26973403b9ef999cab65bf352; no voters:
I20260809 15:44:52.638195 11803 raft_consensus.cc:2781] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:52.638466 11803 raft_consensus.cc:686] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 1 LEADER]: Becoming Leader. State: Replica: b1ddf6d26973403b9ef999cab65bf352, State: Running, Role: LEADER
I20260809 15:44:52.638801 11803 consensus_queue.cc:237] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } }
I20260809 15:44:52.642300 11018 catalog_manager.cc:5495] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1ddf6d26973403b9ef999cab65bf352 (127.14.15.129). New cstate: current_term: 1 leader_uuid: "b1ddf6d26973403b9ef999cab65bf352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1ddf6d26973403b9ef999cab65bf352" member_type: VOTER last_known_addr { host: "127.14.15.129" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 } health_report { overall_health: UNKNOWN } } }
I20260809 15:44:52.672734 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:52.669195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.14.15.129:45381)
0809 15:44:52.669341 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:52.669345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:52.669358 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:44:52.669440 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:52.669443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:52.669500 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:52.669589 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:44:52.669814 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.670334 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.671211 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:52.671432 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:52.671527 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:52.671821 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:44:52.672272 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:44:52.672368 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:52.672473 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 15:44:52.672527 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:44:52.678843 11682 raft_consensus.cc:1261] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 1 FOLLOWER]: Refusing update from remote peer b1ddf6d26973403b9ef999cab65bf352: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:52.678860 11465 raft_consensus.cc:1261] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 1 FOLLOWER]: Refusing update from remote peer b1ddf6d26973403b9ef999cab65bf352: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:44:52.679593 11803 consensus_queue.cc:1035] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f7af31438541eb809c8590d25bd054" member_type: VOTER last_known_addr { host: "127.14.15.130" port: 40133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:52.679782 11806 consensus_queue.cc:1035] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a6ab021120a48e1aa7b9cd36c86ba4b" member_type: VOTER last_known_addr { host: "127.14.15.131" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:44:52.688220 11815 mvcc.cc:205] Tried to move back new op lower bound from 7316645038804676608 to 7316645038651326464. Current Snapshot: MvccSnapshot[applied={T|T < 7316645038804676608}]
I20260809 15:44:52.696938 11020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:52.697134 11020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:44:52.699807 11020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84402337ed2042cb91f6dd967e4c50f4: Sending DeleteTablet for 3 replicas of tablet 1de2452e2ee54231b39fce4171e651bb
I20260809 15:44:52.700608 11210 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de2452e2ee54231b39fce4171e651bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:52 UTC) from {username='slave'} at 127.0.0.1:56486
I20260809 15:44:52.700730 11437 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de2452e2ee54231b39fce4171e651bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:52 UTC) from {username='slave'} at 127.0.0.1:49806
I20260809 15:44:52.700886 11648 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de2452e2ee54231b39fce4171e651bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:44:52 UTC) from {username='slave'} at 127.0.0.1:44436
I20260809 15:44:52.701107 11828 tablet_replica.cc:330] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352: stopping tablet replica
I20260809 15:44:52.701421 11828 raft_consensus.cc:2229] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:44:52.701603 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 11116
I20260809 15:44:52.701826 11828 raft_consensus.cc:2258] T 1de2452e2ee54231b39fce4171e651bb P b1ddf6d26973403b9ef999cab65bf352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:52.713155 11832 tablet_replica.cc:330] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: stopping tablet replica
I20260809 15:44:52.713155 11831 tablet_replica.cc:330] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: stopping tablet replica
I20260809 15:44:52.713572 11832 raft_consensus.cc:2229] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:52.713573 11831 raft_consensus.cc:2229] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:44:52.713992 11832 raft_consensus.cc:2258] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:52.713992 11831 raft_consensus.cc:2258] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:44:52.715775 11831 ts_tablet_manager.cc:1905] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:52.715773 11832 ts_tablet_manager.cc:1905] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:44:52.718672 11832 ts_tablet_manager.cc:1918] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:52.718672 11831 ts_tablet_manager.cc:1918] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:44:52.718786 11831 log.cc:1196] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-1/wal/wals/1de2452e2ee54231b39fce4171e651bb
I20260809 15:44:52.718786 11832 log.cc:1196] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Deleting WAL directory at /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786290023600843-14398-0/minicluster-data/ts-2/wal/wals/1de2452e2ee54231b39fce4171e651bb
I20260809 15:44:52.719117 11832 ts_tablet_manager.cc:1939] T 1de2452e2ee54231b39fce4171e651bb P 5a6ab021120a48e1aa7b9cd36c86ba4b: Deleting consensus metadata
I20260809 15:44:52.719116 11831 ts_tablet_manager.cc:1939] T 1de2452e2ee54231b39fce4171e651bb P 47f7af31438541eb809c8590d25bd054: Deleting consensus metadata
W20260809 15:44:52.719964 11003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.15.129:45381 (error 108)
I20260809 15:44:52.720464 11004 catalog_manager.cc:4841] TS 5a6ab021120a48e1aa7b9cd36c86ba4b (127.14.15.131:40917): tablet 1de2452e2ee54231b39fce4171e651bb (table test-table [id=54a164543b49413b9e3c9c919a7f1bde]) successfully deleted
I20260809 15:44:52.720718 11004 catalog_manager.cc:4841] TS 47f7af31438541eb809c8590d25bd054 (127.14.15.130:40133): tablet 1de2452e2ee54231b39fce4171e651bb (table test-table [id=54a164543b49413b9e3c9c919a7f1bde]) successfully deleted
W20260809 15:44:52.721084 11776 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:44:52.720782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.129:45381 (local address 127.0.0.1:56510)
0809 15:44:52.720920 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 15:44:52.721002 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.129:45381: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:44:52.721238 11003 catalog_manager.cc:4584] TS b1ddf6d26973403b9ef999cab65bf352 (127.14.15.129:45381): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1de2452e2ee54231b39fce4171e651bb: Network error: Client connection negotiation failed: client connection to 127.14.15.129:45381: connect: Connection reset by peer (error 104)
I20260809 15:44:52.721312 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 11326
I20260809 15:44:52.739522 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 11551
I20260809 15:44:52.754972 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 10977
2026-08-09T15:44:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1196 ms)
[----------] 6 tests from EncryptionPolicyTest (11330 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:52 dist-test-slave-jztv krb5kdc[11837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:52 dist-test-slave-jztv krb5kdc[11837](info): set up 2 sockets
Aug 09 15:44:52 dist-test-slave-jztv krb5kdc[11837](info): commencing operation
krb5kdc: starting...
W20260809 15:44:54.024561 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:44:54.159294 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:54.274362 11861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:54.274677 11861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:54.274752 11861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:54.278828 11861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:54.278921 11861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:54.278959 11861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:54.278996 11861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:54.279040 11861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:54.286963 11861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:54.288064 11861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:54.289081 11861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:54.297780 11873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:54.297747 11867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:54.297842 11861 server_base.cc:1034] running on GCE node
W20260809 15:44:54.297791 11871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:54.298633 11861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:54.299739 11861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:54.300900 11861 hybrid_clock.cc:648] HybridClock initialized: now 1786290294300872 us; error 40 us; skew 500 ppm
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290294, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:54.307294 11861 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:44:54.308290 11861 webserver.cc:460] Webserver started at http://127.0.0.1:34553/ using document root <none> and password file <none>
I20260809 15:44:54.308895 11861 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:54.308959 11861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:54.309222 11861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:54.311419 11861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "4b1ae997e7484b3e900b8a47fdd82e20"
format_stamp: "Formatted at 2026-08-09 15:44:54 on dist-test-slave-jztv"
server_key: "7669f5089ec184bd17a72cc6dc28e9fb"
server_key_iv: "8c50b72f74ce8db3afc61990d52add2b"
server_key_version: "encryptionkey@0"
I20260809 15:44:54.312016 11861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "4b1ae997e7484b3e900b8a47fdd82e20"
format_stamp: "Formatted at 2026-08-09 15:44:54 on dist-test-slave-jztv"
server_key: "7669f5089ec184bd17a72cc6dc28e9fb"
server_key_iv: "8c50b72f74ce8db3afc61990d52add2b"
server_key_version: "encryptionkey@0"
I20260809 15:44:54.315840 11861 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 15:44:54.318466 11882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:54.319787 11861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:44:54.319936 11861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "4b1ae997e7484b3e900b8a47fdd82e20"
format_stamp: "Formatted at 2026-08-09 15:44:54 on dist-test-slave-jztv"
server_key: "7669f5089ec184bd17a72cc6dc28e9fb"
server_key_iv: "8c50b72f74ce8db3afc61990d52add2b"
server_key_version: "encryptionkey@0"
I20260809 15:44:54.320060 11861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:54.331852 11861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:54.335162 11861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:54.335376 11861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:54.342895 11861 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39265
I20260809 15:44:54.342923 11958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39265 every 8 connection(s)
I20260809 15:44:54.343842 11861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:54.346637 11961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:54.346932 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 11861
I20260809 15:44:54.347087 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:54.347389 14398 external_mini_cluster.cc:1428] Setting key 5c43df22b4ebae973d8d06ecf602c3d1
I20260809 15:44:54.354341 11961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20: Bootstrap starting.
I20260809 15:44:54.356797 11961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20: Neither blocks nor log segments found. Creating new log.
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[11837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:44:54.357678 11961 log.cc:824] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:54.360258 11961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20: No bootstrap required, opened a new log
I20260809 15:44:54.363008 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:54.348873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49637 (local address 127.0.0.1:39265)
0809 15:44:54.349326 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:54.349347 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:54.349391 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:44:54.350141 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:54.350165 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:54.350629 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:54.351017 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:54.351793 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:54.353362 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:54.354269 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:54.354949 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:54.355109 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:54.357742 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:54.357748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:54.357766 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:54.357801 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:54.359910 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:54.360483 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:54.360488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:54.360494 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:54.360616 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:54.361002 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:54.361006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:54.361007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:54.361406 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:54.361660 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:54.361992 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 15:44:54.362267 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":119,"threads_started":1}
I20260809 15:44:54.364250 11961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260809 15:44:54.364532 11961 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:54.364606 11961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b1ae997e7484b3e900b8a47fdd82e20, State: Initialized, Role: FOLLOWER
I20260809 15:44:54.365080 11961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260809 15:44:54.365221 11961 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:54.365315 11961 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:54.365432 11961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:54.366168 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:44:54.366624 11961 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260809 15:44:54.366981 11961 leader_election.cc:302] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b1ae997e7484b3e900b8a47fdd82e20; no voters:
I20260809 15:44:54.367345 11961 leader_election.cc:288] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:54.367525 11971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:54.367868 11971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [term 1 LEADER]: Becoming Leader. State: Replica: 4b1ae997e7484b3e900b8a47fdd82e20, State: Running, Role: LEADER
I20260809 15:44:54.368230 11971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260809 15:44:54.368727 11961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:54.369565 11971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b1ae997e7484b3e900b8a47fdd82e20. Latest consensus state: current_term: 1 leader_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260809 15:44:54.369732 11971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:54.370105 11993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:54.370203 11978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b1ae997e7484b3e900b8a47fdd82e20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260809 15:44:54.370414 11978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:54.373683 11993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:54.380573 11993 catalog_manager.cc:1347] Generated new cluster ID: 5b697a9bb3a545ea9f8515c679e9d986
I20260809 15:44:54.380649 11993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:54.380829 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:54.368387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45605 (local address 127.0.0.1:39265)
0809 15:44:54.368500 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:54.368504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:54.371176 (+ 2672us) server_negotiation.cc:407] Connection header received
0809 15:44:54.371316 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:54.371320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:54.371371 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:54.371446 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:54.372442 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:54.373216 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:54.374383 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:54.374722 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:54.374821 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:54.376595 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:54.376599 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:54.376602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:54.376636 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:54.378314 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:54.378955 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:54.378959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:54.378961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:54.379067 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:54.379501 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:54.379505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:54.379506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:54.379731 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:54.379876 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:54.380555 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 15:44:54.380661 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:44:54.396152 11993 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:54.397154 11993 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:54.404285 11993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b1ae997e7484b3e900b8a47fdd82e20: Generated new TSK 0
I20260809 15:44:54.405092 11993 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:54.409178 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 11861
W20260809 15:44:54.424002 11835 connection.cc:535] client connection to 127.0.0.1:39265 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39265): Connection reset by peer (error 104)
2026-08-09T15:44:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1655 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[12010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[12010](info): set up 2 sockets
Aug 09 15:44:54 dist-test-slave-jztv krb5kdc[12010](info): commencing operation
krb5kdc: starting...
W20260809 15:44:55.643292 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:55 dist-test-slave-jztv krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:44:55.777601 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:55.901777 12026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:55.902133 12026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:55.902266 12026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:55.906426 12026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:55.906527 12026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:55.906562 12026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:55.906605 12026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:55.906654 12026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:55.912225 12026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:55.913400 12026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:55.914513 12026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:55.923568 12035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:55.923630 12038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:55.923580 12041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:55.923635 12026 server_base.cc:1034] running on GCE node
I20260809 15:44:55.924454 12026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:55.925598 12026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:55.926805 12026 hybrid_clock.cc:648] HybridClock initialized: now 1786290295926778 us; error 39 us; skew 500 ppm
Aug 09 15:44:55 dist-test-slave-jztv krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290295, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:55.929960 12026 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:44:55.930999 12026 webserver.cc:460] Webserver started at http://127.0.0.1:34445/ using document root <none> and password file <none>
I20260809 15:44:55.931607 12026 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:55.931705 12026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:55.931958 12026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:55.934115 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "59c58466e0a84643abc58a6b1ce29af6"
format_stamp: "Formatted at 2026-08-09 15:44:55 on dist-test-slave-jztv"
server_key: "a8f480418e8d682d8d2864b7a0848171"
server_key_iv: "4726d2c0a9fecf85ec959501d40e0f91"
server_key_version: "encryptionkey@0"
I20260809 15:44:55.934777 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "59c58466e0a84643abc58a6b1ce29af6"
format_stamp: "Formatted at 2026-08-09 15:44:55 on dist-test-slave-jztv"
server_key: "a8f480418e8d682d8d2864b7a0848171"
server_key_iv: "4726d2c0a9fecf85ec959501d40e0f91"
server_key_version: "encryptionkey@0"
I20260809 15:44:55.938725 12026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:44:55.941246 12052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:55.942565 12026 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:44:55.942713 12026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "59c58466e0a84643abc58a6b1ce29af6"
format_stamp: "Formatted at 2026-08-09 15:44:55 on dist-test-slave-jztv"
server_key: "a8f480418e8d682d8d2864b7a0848171"
server_key_iv: "4726d2c0a9fecf85ec959501d40e0f91"
server_key_version: "encryptionkey@0"
I20260809 15:44:55.942814 12026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:55.957682 12026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:55.960917 12026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:55.961136 12026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:55.968775 12026 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44905
I20260809 15:44:55.968892 12146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44905 every 8 connection(s)
I20260809 15:44:55.969826 12026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:55.972780 12147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:55.975215 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12026
I20260809 15:44:55.975368 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:55.975715 14398 external_mini_cluster.cc:1428] Setting key 82deaa6ba4a74207a7024e9d8aaeab5b
I20260809 15:44:55.979938 12147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: Bootstrap starting.
I20260809 15:44:55.982296 12147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:55.983057 12147 log.cc:824] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:55.984745 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:55.977130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37615 (local address 127.0.0.1:44905)
0809 15:44:55.977587 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:55.977604 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:55.977639 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:44:55.978354 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:55.978373 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:55.978718 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:55.979075 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:55.979489 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:55.980483 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:55.981375 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:55.981845 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:55.982021 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:55.982991 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:55.982996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:55.983010 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:55.983511 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:55.983569 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:55.983593 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:55.983733 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:55.983911 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 15:44:55.984056 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":141,"threads_started":1}
I20260809 15:44:55.985215 12147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: No bootstrap required, opened a new log
I20260809 15:44:55.987754 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:44:55.989219 12147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260809 15:44:55.989482 12147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:55.989548 12147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c58466e0a84643abc58a6b1ce29af6, State: Initialized, Role: FOLLOWER
I20260809 15:44:55.990054 12147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260809 15:44:55.990258 12147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:55.990324 12147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:55.990419 12147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:55.991360 12147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260809 15:44:55.991760 12147 leader_election.cc:302] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c58466e0a84643abc58a6b1ce29af6; no voters:
I20260809 15:44:55.992148 12147 leader_election.cc:288] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:55.992187 12161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:55.992403 12161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [term 1 LEADER]: Becoming Leader. State: Replica: 59c58466e0a84643abc58a6b1ce29af6, State: Running, Role: LEADER
I20260809 15:44:55.992795 12161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260809 15:44:55.993531 12147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:55.994081 12161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c58466e0a84643abc58a6b1ce29af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } } }
I20260809 15:44:55.994457 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:55.989754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39775 (local address 127.0.0.1:44905)
0809 15:44:55.989895 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:55.989900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:55.990077 (+ 177us) server_negotiation.cc:407] Connection header received
0809 15:44:55.990256 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:55.990259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:55.990303 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:55.990604 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:55.990881 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:55.991414 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:55.992371 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:55.992704 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:55.992820 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:55.993746 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:55.993755 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:55.993757 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:55.993769 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:55.993794 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:55.993804 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:55.993904 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:55.994187 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 15:44:55.994249 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:44:55.994985 12162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c58466e0a84643abc58a6b1ce29af6. Latest consensus state: current_term: 1 leader_uuid: "59c58466e0a84643abc58a6b1ce29af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c58466e0a84643abc58a6b1ce29af6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } } }
I20260809 15:44:55.995111 12162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:55.994298 12161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6 [sys.catalog]: This master's current role is: LEADER
W20260809 15:44:55.998642 12188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:44:55.998708 12188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:44:55.998795 12183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:55.999559 12183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:56.005016 12183 catalog_manager.cc:1347] Generated new cluster ID: 562c0c5e9fff4a90b4e303ac1f6dd7a4
I20260809 15:44:56.005089 12183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:56.021639 12183 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:56.023049 12183 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:56.040664 12183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59c58466e0a84643abc58a6b1ce29af6: Generated new TSK 0
I20260809 15:44:56.041512 12183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:56.045571 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12026
W20260809 15:44:56.055146 12007 connection.cc:535] client connection to 127.0.0.1:44905 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44905): Connection reset by peer (error 104)
2026-08-09T15:44:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:56 dist-test-slave-jztv krb5kdc[12197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:56 dist-test-slave-jztv krb5kdc[12197](info): set up 2 sockets
Aug 09 15:44:56 dist-test-slave-jztv krb5kdc[12197](info): commencing operation
krb5kdc: starting...
W20260809 15:44:57.305188 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:57 dist-test-slave-jztv krb5kdc[12197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:44:57.438001 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:57.553202 12220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:57.553510 12220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:57.553556 12220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:57.557561 12220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:57.557631 12220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:57.557651 12220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:57.557668 12220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:57.557683 12220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:57.563130 12220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:57.564206 12220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:57.565191 12220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:57.574051 12229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:57.574047 12228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:57.574316 12220 server_base.cc:1034] running on GCE node
W20260809 15:44:57.574047 12231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:57.575096 12220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:57.576259 12220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:57.577455 12220 hybrid_clock.cc:648] HybridClock initialized: now 1786290297577424 us; error 52 us; skew 500 ppm
Aug 09 15:44:57 dist-test-slave-jztv krb5kdc[12197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:57.580530 12220 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:44:57.581570 12220 webserver.cc:460] Webserver started at http://127.0.0.1:39743/ using document root <none> and password file <none>
I20260809 15:44:57.582170 12220 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:57.582295 12220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:57.582542 12220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:57.584692 12220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "ec44291615da47d0b303f725eb554337"
format_stamp: "Formatted at 2026-08-09 15:44:57 on dist-test-slave-jztv"
server_key: "3c7a71f178a8b2640089694ce7aa9705"
server_key_iv: "42b1b76ff795f4f1000b28e9ea7f9dd9"
server_key_version: "encryptionkey@0"
I20260809 15:44:57.585306 12220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "ec44291615da47d0b303f725eb554337"
format_stamp: "Formatted at 2026-08-09 15:44:57 on dist-test-slave-jztv"
server_key: "3c7a71f178a8b2640089694ce7aa9705"
server_key_iv: "42b1b76ff795f4f1000b28e9ea7f9dd9"
server_key_version: "encryptionkey@0"
I20260809 15:44:57.590153 12220 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260809 15:44:57.593892 12245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:57.595543 12220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:44:57.595860 12220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "ec44291615da47d0b303f725eb554337"
format_stamp: "Formatted at 2026-08-09 15:44:57 on dist-test-slave-jztv"
server_key: "3c7a71f178a8b2640089694ce7aa9705"
server_key_iv: "42b1b76ff795f4f1000b28e9ea7f9dd9"
server_key_version: "encryptionkey@0"
I20260809 15:44:57.596051 12220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:57.601301 12220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:57.605221 12220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:57.605466 12220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:57.613698 12220 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43119
I20260809 15:44:57.613727 12323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43119 every 8 connection(s)
I20260809 15:44:57.614838 12220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:57.615245 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12220
I20260809 15:44:57.615406 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:57.615732 14398 external_mini_cluster.cc:1428] Setting key 16505bdb5282984e2aa34366cd80bd2f
I20260809 15:44:57.618470 12325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:57.621533 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:57.617240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34793 (local address 127.0.0.1:43119)
0809 15:44:57.617737 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:57.617754 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:57.617795 (+ 41us) server_negotiation.cc:407] Connection header received
0809 15:44:57.618636 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:57.618657 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:57.618964 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:57.619324 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:57.620251 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:57.620258 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:57.620275 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:57.620288 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:57.620364 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:57.620387 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:57.620550 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:57.620624 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 15:44:57.620789 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":155,"threads_started":1}
I20260809 15:44:57.625036 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:44:57.625599 12325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337: Bootstrap starting.
I20260809 15:44:57.628299 12325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:57.629081 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:57.627282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59575 (local address 127.0.0.1:43119)
0809 15:44:57.627427 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:57.627432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:57.627622 (+ 190us) server_negotiation.cc:407] Connection header received
0809 15:44:57.627768 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:57.627770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:57.627802 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:57.627866 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:57.628651 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:57.628654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:57.628656 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:44:57.628667 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:57.628693 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:44:57.628704 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:57.628773 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:57.628879 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 15:44:57.628910 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:44:57.629338 12325 log.cc:824] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:57.631471 12325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337: No bootstrap required, opened a new log
I20260809 15:44:57.635308 12325 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260809 15:44:57.635547 12325 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:57.635615 12325 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec44291615da47d0b303f725eb554337, State: Initialized, Role: FOLLOWER
I20260809 15:44:57.636096 12325 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260809 15:44:57.636245 12325 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:57.636334 12325 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:57.636454 12325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:57.637427 12325 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260809 15:44:57.637780 12325 leader_election.cc:302] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec44291615da47d0b303f725eb554337; no voters:
I20260809 15:44:57.638136 12325 leader_election.cc:288] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:57.638304 12340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:57.638573 12340 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [term 1 LEADER]: Becoming Leader. State: Replica: ec44291615da47d0b303f725eb554337, State: Running, Role: LEADER
I20260809 15:44:57.638931 12340 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260809 15:44:57.639518 12325 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:57.640776 12344 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec44291615da47d0b303f725eb554337. Latest consensus state: current_term: 1 leader_uuid: "ec44291615da47d0b303f725eb554337" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } } }
I20260809 15:44:57.640918 12344 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:57.641258 12343 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec44291615da47d0b303f725eb554337" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec44291615da47d0b303f725eb554337" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } } }
I20260809 15:44:57.641330 12354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:57.641360 12343 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:57.644435 12354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:57.650189 12354 catalog_manager.cc:1347] Generated new cluster ID: acbad57596a54a559228444c2ad4f685
I20260809 15:44:57.650293 12354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:57.697242 12354 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:57.697616 12354 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:57.705225 12354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec44291615da47d0b303f725eb554337: Generated new TSK 0
I20260809 15:44:57.706043 12354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:57.715775 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12220
2026-08-09T15:44:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1674 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:57 dist-test-slave-jztv krb5kdc[12376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:57 dist-test-slave-jztv krb5kdc[12376](info): set up 2 sockets
Aug 09 15:44:57 dist-test-slave-jztv krb5kdc[12376](info): commencing operation
krb5kdc: starting...
W20260809 15:44:58.948431 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:44:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:44:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:44:59.077596 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35715
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:44:59.195572 12392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:44:59.195869 12392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:44:59.195961 12392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:44:59.200037 12392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:44:59.200126 12392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:44:59.200165 12392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:44:59.200224 12392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:44:59.200264 12392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:44:59.205658 12392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:44:59.206779 12392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:44:59.207798 12392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:44:59.216432 12405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:59.216486 12392 server_base.cc:1034] running on GCE node
W20260809 15:44:59.216461 12403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:44:59.216432 12401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:44:59.217303 12392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:44:59.218514 12392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:44:59.219719 12392 hybrid_clock.cc:648] HybridClock initialized: now 1786290299219688 us; error 41 us; skew 500 ppm
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290299, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:44:59.222528 12392 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:44:59.223443 12392 webserver.cc:460] Webserver started at http://127.0.0.1:36757/ using document root <none> and password file <none>
I20260809 15:44:59.223969 12392 fs_manager.cc:359] Metadata directory not provided
I20260809 15:44:59.224027 12392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:44:59.224256 12392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:44:59.226419 12392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "b8968b33192f42c7beb2f41e58c82b39"
format_stamp: "Formatted at 2026-08-09 15:44:59 on dist-test-slave-jztv"
server_key: "05aacd823466471df949b0529b24007e"
server_key_iv: "fcb1934b6a2872af985f98eb112fad30"
server_key_version: "encryptionkey@0"
I20260809 15:44:59.226974 12392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "b8968b33192f42c7beb2f41e58c82b39"
format_stamp: "Formatted at 2026-08-09 15:44:59 on dist-test-slave-jztv"
server_key: "05aacd823466471df949b0529b24007e"
server_key_iv: "fcb1934b6a2872af985f98eb112fad30"
server_key_version: "encryptionkey@0"
I20260809 15:44:59.230792 12392 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:44:59.233269 12413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:44:59.234696 12392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:44:59.234830 12392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "b8968b33192f42c7beb2f41e58c82b39"
format_stamp: "Formatted at 2026-08-09 15:44:59 on dist-test-slave-jztv"
server_key: "05aacd823466471df949b0529b24007e"
server_key_iv: "fcb1934b6a2872af985f98eb112fad30"
server_key_version: "encryptionkey@0"
I20260809 15:44:59.234939 12392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:44:59.246850 12392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:44:59.249805 12392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:44:59.250018 12392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:44:59.257238 12392 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35715
I20260809 15:44:59.257247 12502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35715 every 8 connection(s)
I20260809 15:44:59.258162 12392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:44:59.260851 12503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:44:59.265075 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12392
I20260809 15:44:59.265229 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:44:59.265520 14398 external_mini_cluster.cc:1428] Setting key 2f80e7a81e4c6d37d3639a78b10e2a54
I20260809 15:44:59.267027 12503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: Bootstrap starting.
I20260809 15:44:59.269142 12503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: Neither blocks nor log segments found. Creating new log.
I20260809 15:44:59.269878 12503 log.cc:824] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: Log is configured to *not* fsync() on all Append() calls
I20260809 15:44:59.271648 12503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: No bootstrap required, opened a new log
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:44:59.275418 12503 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 15:44:59.275703 12503 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:44:59.275770 12503 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8968b33192f42c7beb2f41e58c82b39, State: Initialized, Role: FOLLOWER
I20260809 15:44:59.276217 12503 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 15:44:59.276340 12503 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:44:59.276423 12503 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:44:59.276554 12503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:44:59.277385 12503 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 15:44:59.277724 12503 leader_election.cc:302] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8968b33192f42c7beb2f41e58c82b39; no voters:
I20260809 15:44:59.278031 12503 leader_election.cc:288] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:44:59.278147 12513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:44:59.278409 12513 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [term 1 LEADER]: Becoming Leader. State: Replica: b8968b33192f42c7beb2f41e58c82b39, State: Running, Role: LEADER
I20260809 15:44:59.278800 12513 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 15:44:59.279330 12503 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:44:59.280115 12513 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8968b33192f42c7beb2f41e58c82b39. Latest consensus state: current_term: 1 leader_uuid: "b8968b33192f42c7beb2f41e58c82b39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } } }
I20260809 15:44:59.280290 12513 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:59.280507 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:59.266908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39781 (local address 127.0.0.1:35715)
0809 15:44:59.267386 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:59.267401 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:59.267434 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:44:59.268053 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:59.268069 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:59.268381 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:59.268708 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:59.269559 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:59.270651 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:59.271505 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:59.272028 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:59.272196 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:59.274710 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:59.274714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:59.274727 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:59.274754 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:59.276798 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:59.277239 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:59.277246 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:59.277251 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:59.277368 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:59.277701 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:59.277705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:59.277707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:59.278277 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:59.279088 (+ 811us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:59.279238 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 15:44:59.279538 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":130,"threads_started":1}
I20260809 15:44:59.280561 12514 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8968b33192f42c7beb2f41e58c82b39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8968b33192f42c7beb2f41e58c82b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } } }
I20260809 15:44:59.280710 12514 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39 [sys.catalog]: This master's current role is: LEADER
I20260809 15:44:59.283766 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 15:44:59.284515 12535 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:44:59.284600 12535 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:44:59.284670 12527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:44:59.285615 12527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:44:59.291961 12527 catalog_manager.cc:1347] Generated new cluster ID: fc1be201eb5c4e8094b5710f5d3ba8bb
I20260809 15:44:59.292039 12527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:44:59.294824 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:44:59.286061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40805 (local address 127.0.0.1:35715)
0809 15:44:59.286170 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:44:59.286175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:44:59.286406 (+ 231us) server_negotiation.cc:407] Connection header received
0809 15:44:59.286528 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:44:59.286532 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:44:59.286579 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:44:59.286659 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:44:59.287448 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:59.288273 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:59.289366 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:44:59.289762 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:44:59.289875 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:44:59.291309 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:44:59.291313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:44:59.291315 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:44:59.291343 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:44:59.293086 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:59.293570 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:59.293573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:59.293575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:59.293658 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:44:59.293959 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:44:59.293962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:44:59.293963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:44:59.294151 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:44:59.294302 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:44:59.294572 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 15:44:59.294679 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:44:59.314517 12527 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:44:59.315852 12527 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:44:59.324254 12527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8968b33192f42c7beb2f41e58c82b39: Generated new TSK 0
I20260809 15:44:59.325070 12527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:44:59.333197 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12392
2026-08-09T15:44:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12551](info): set up 2 sockets
Aug 09 15:44:59 dist-test-slave-jztv krb5kdc[12551](info): commencing operation
krb5kdc: starting...
W20260809 15:45:00.565279 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:00 dist-test-slave-jztv krb5kdc[12551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:00.694465 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:00.809696 12570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:00.810012 12570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:00.810096 12570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:00.814137 12570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:00.814250 12570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:00.814293 12570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:00.814349 12570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:00.814396 12570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:00.819639 12570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:00.820753 12570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:00.821797 12570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:00.830541 12575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:00.830544 12576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:00.830518 12578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:00.830806 12570 server_base.cc:1034] running on GCE node
I20260809 15:45:00.831485 12570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:00.832954 12570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:00.834133 12570 hybrid_clock.cc:648] HybridClock initialized: now 1786290300834107 us; error 43 us; skew 500 ppm
Aug 09 15:45:00 dist-test-slave-jztv krb5kdc[12551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:00.838104 12570 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:00.840801 12570 webserver.cc:460] Webserver started at http://127.0.0.1:34851/ using document root <none> and password file <none>
I20260809 15:45:00.841418 12570 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:00.841519 12570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:00.841758 12570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:00.844442 12570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "0961d48721884ee9976a33cfa545cac4"
format_stamp: "Formatted at 2026-08-09 15:45:00 on dist-test-slave-jztv"
server_key: "d85f446ad2e0fb73f684e0f0c28edd41"
server_key_iv: "8600131c14de478cc049cdd44b5c87fc"
server_key_version: "encryptionkey@0"
I20260809 15:45:00.845049 12570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "0961d48721884ee9976a33cfa545cac4"
format_stamp: "Formatted at 2026-08-09 15:45:00 on dist-test-slave-jztv"
server_key: "d85f446ad2e0fb73f684e0f0c28edd41"
server_key_iv: "8600131c14de478cc049cdd44b5c87fc"
server_key_version: "encryptionkey@0"
I20260809 15:45:00.848824 12570 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:45:00.851356 12588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:00.852660 12570 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:45:00.852815 12570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "0961d48721884ee9976a33cfa545cac4"
format_stamp: "Formatted at 2026-08-09 15:45:00 on dist-test-slave-jztv"
server_key: "d85f446ad2e0fb73f684e0f0c28edd41"
server_key_iv: "8600131c14de478cc049cdd44b5c87fc"
server_key_version: "encryptionkey@0"
I20260809 15:45:00.852943 12570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:00.869732 12570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:00.873265 12570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:00.873519 12570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:00.881008 12570 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33707
I20260809 15:45:00.881033 12669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33707 every 8 connection(s)
I20260809 15:45:00.882048 12570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:00.883558 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12570
I20260809 15:45:00.883723 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:00.884057 14398 external_mini_cluster.cc:1428] Setting key f2756e40f8cad159dcaecadae8a4f76b
I20260809 15:45:00.885461 12672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:00.891283 12672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4: Bootstrap starting.
I20260809 15:45:00.893698 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:00.885566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58875 (local address 127.0.0.1:33707)
0809 15:45:00.886046 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:00.886063 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:00.886102 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:45:00.886855 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:00.886872 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:00.887218 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:00.887575 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:00.887986 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:00.888984 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:00.889911 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:00.890481 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:00.890665 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:00.891650 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:00.891657 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:00.891673 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:00.892162 (+ 489us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:00.892233 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:00.892265 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:00.892370 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:00.892525 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 15:45:00.892759 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":152,"threads_started":1}
I20260809 15:45:00.894111 12672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:00.895041 12672 log.cc:824] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:00.896767 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:00.897330 12672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4: No bootstrap required, opened a new log
I20260809 15:45:00.902016 12672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } }
I20260809 15:45:00.902405 12672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:00.902494 12672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0961d48721884ee9976a33cfa545cac4, State: Initialized, Role: FOLLOWER
I20260809 15:45:00.903085 12672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } }
I20260809 15:45:00.903268 12672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:00.903365 12672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:00.903415 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:00.898961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50881 (local address 127.0.0.1:33707)
0809 15:45:00.899097 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:00.899101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:00.899252 (+ 151us) server_negotiation.cc:407] Connection header received
0809 15:45:00.899400 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:00.899402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:00.899442 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:00.899500 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:00.899862 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:00.900482 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:00.901651 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:00.901905 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:00.901994 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:00.902917 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:00.902920 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:00.902922 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:00.902934 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:00.902960 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:00.902970 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:00.903034 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:00.903151 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 15:45:00.903202 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:45:00.903481 12672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:00.904770 12672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } }
I20260809 15:45:00.905151 12672 leader_election.cc:302] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0961d48721884ee9976a33cfa545cac4; no voters:
I20260809 15:45:00.905512 12672 leader_election.cc:288] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:00.905712 12690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:00.905946 12690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [term 1 LEADER]: Becoming Leader. State: Replica: 0961d48721884ee9976a33cfa545cac4, State: Running, Role: LEADER
I20260809 15:45:00.906332 12690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } }
I20260809 15:45:00.906898 12672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:00.908239 12694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0961d48721884ee9976a33cfa545cac4. Latest consensus state: current_term: 1 leader_uuid: "0961d48721884ee9976a33cfa545cac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } } }
I20260809 15:45:00.908254 12691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0961d48721884ee9976a33cfa545cac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0961d48721884ee9976a33cfa545cac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33707 } } }
I20260809 15:45:00.908385 12694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:00.908386 12691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:00.908811 12708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:00.912225 12708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:00.918581 12708 catalog_manager.cc:1347] Generated new cluster ID: 67424077d8d7462db2bccece8e343328
I20260809 15:45:00.918673 12708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:00.957111 12708 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:00.958464 12708 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:00.964740 12708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0961d48721884ee9976a33cfa545cac4: Generated new TSK 0
I20260809 15:45:00.965448 12708 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:00.974682 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12570
2026-08-09T15:45:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1642 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:01 dist-test-slave-jztv krb5kdc[12721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:01 dist-test-slave-jztv krb5kdc[12721](info): set up 2 sockets
Aug 09 15:45:01 dist-test-slave-jztv krb5kdc[12721](info): commencing operation
krb5kdc: starting...
W20260809 15:45:02.207785 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:02 dist-test-slave-jztv krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:02.339383 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:02.451221 12742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:02.451546 12742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:02.451627 12742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:02.455722 12742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:02.455781 12742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:02.455801 12742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:02.455818 12742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:02.455832 12742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:02.461216 12742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:02.462256 12742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:02.463534 12742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:02.473747 12755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:02.473738 12749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:02.473749 12751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:02.474324 12742 server_base.cc:1034] running on GCE node
I20260809 15:45:02.474929 12742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:02.476071 12742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:02.477265 12742 hybrid_clock.cc:648] HybridClock initialized: now 1786290302477212 us; error 45 us; skew 500 ppm
Aug 09 15:45:02 dist-test-slave-jztv krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290302, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:02.480237 12742 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:02.481202 12742 webserver.cc:460] Webserver started at http://127.0.0.1:33727/ using document root <none> and password file <none>
I20260809 15:45:02.481783 12742 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:02.481878 12742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:02.482120 12742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:02.484252 12742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "530c5f978ec74db297f5964503f8cf20"
format_stamp: "Formatted at 2026-08-09 15:45:02 on dist-test-slave-jztv"
server_key: "41460ed1f3af05195ccafa2b4e966fea"
server_key_iv: "6a556d173a2d0a18b53a141b6bba5b3c"
server_key_version: "encryptionkey@0"
I20260809 15:45:02.484858 12742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "530c5f978ec74db297f5964503f8cf20"
format_stamp: "Formatted at 2026-08-09 15:45:02 on dist-test-slave-jztv"
server_key: "41460ed1f3af05195ccafa2b4e966fea"
server_key_iv: "6a556d173a2d0a18b53a141b6bba5b3c"
server_key_version: "encryptionkey@0"
I20260809 15:45:02.488704 12742 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:45:02.491180 12767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:02.492439 12742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:45:02.492601 12742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "530c5f978ec74db297f5964503f8cf20"
format_stamp: "Formatted at 2026-08-09 15:45:02 on dist-test-slave-jztv"
server_key: "41460ed1f3af05195ccafa2b4e966fea"
server_key_iv: "6a556d173a2d0a18b53a141b6bba5b3c"
server_key_version: "encryptionkey@0"
I20260809 15:45:02.492722 12742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:02.497444 12742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:02.500490 12742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:02.500682 12742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:02.508316 12742 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35317
I20260809 15:45:02.508340 12853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35317 every 8 connection(s)
I20260809 15:45:02.509210 12742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:02.511910 12855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:02.515997 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12742
I20260809 15:45:02.516153 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:02.516502 14398 external_mini_cluster.cc:1428] Setting key 6b6c24fbd9852f3376e0d00164bc45c0
I20260809 15:45:02.518676 12855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20: Bootstrap starting.
I20260809 15:45:02.521284 12855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:02.522086 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:02.517985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41631 (local address 127.0.0.1:35317)
0809 15:45:02.518481 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:02.518496 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:02.518532 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:45:02.519235 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:02.519254 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:02.519564 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:02.519920 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:02.520810 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:02.520815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:02.520828 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:02.520838 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:02.520896 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:02.520926 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:02.521044 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:02.521153 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 15:45:02.521317 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":149,"threads_started":1}
I20260809 15:45:02.522091 12855 log.cc:824] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:02.524447 12855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20: No bootstrap required, opened a new log
I20260809 15:45:02.525233 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:02.528908 12855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } }
I20260809 15:45:02.529269 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:02.527672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39645 (local address 127.0.0.1:35317)
0809 15:45:02.527811 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:02.527816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:02.527955 (+ 139us) server_negotiation.cc:407] Connection header received
0809 15:45:02.528049 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:02.528052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:02.528091 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:02.528177 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:02.528857 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:02.528861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:02.528864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:02.528877 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:02.528909 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:02.528925 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:02.529033 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:02.529102 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 15:45:02.529143 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:45:02.529322 12855 raft_consensus.cc:374] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:02.529376 12855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530c5f978ec74db297f5964503f8cf20, State: Initialized, Role: FOLLOWER
I20260809 15:45:02.529865 12855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } }
I20260809 15:45:02.530035 12855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:02.530114 12855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:02.530254 12855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:02.531275 12855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } }
I20260809 15:45:02.531647 12855 leader_election.cc:302] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 530c5f978ec74db297f5964503f8cf20; no voters:
I20260809 15:45:02.531968 12855 leader_election.cc:288] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:02.532121 12871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:02.532356 12871 raft_consensus.cc:686] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [term 1 LEADER]: Becoming Leader. State: Replica: 530c5f978ec74db297f5964503f8cf20, State: Running, Role: LEADER
I20260809 15:45:02.532742 12871 consensus_queue.cc:237] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } }
I20260809 15:45:02.533331 12855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:02.534660 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "530c5f978ec74db297f5964503f8cf20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } } }
I20260809 15:45:02.534654 12874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 530c5f978ec74db297f5964503f8cf20. Latest consensus state: current_term: 1 leader_uuid: "530c5f978ec74db297f5964503f8cf20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530c5f978ec74db297f5964503f8cf20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35317 } } }
I20260809 15:45:02.534835 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:02.534847 12874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:02.535341 12884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:02.538273 12884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:02.543654 12884 catalog_manager.cc:1347] Generated new cluster ID: 28219eb5e5874f11bd61fd56e94aa1ab
I20260809 15:45:02.543721 12884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:02.564211 12884 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:02.564559 12884 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:02.587195 12884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 530c5f978ec74db297f5964503f8cf20: Generated new TSK 0
I20260809 15:45:02.587975 12884 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:02.599977 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12742
2026-08-09T15:45:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1626 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:02 dist-test-slave-jztv krb5kdc[12901](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:02 dist-test-slave-jztv krb5kdc[12901](info): set up 2 sockets
Aug 09 15:45:02 dist-test-slave-jztv krb5kdc[12901](info): commencing operation
krb5kdc: starting...
W20260809 15:45:03.833864 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:03 dist-test-slave-jztv krb5kdc[12901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:03.966500 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34181
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:04.081740 12918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:04.082037 12918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:04.082093 12918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:04.086351 12918 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:04.086419 12918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:04.086439 12918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:04.086457 12918 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:04.086472 12918 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:04.091943 12918 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:04.093070 12918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:04.094141 12918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:04.105021 12925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:04.105189 12918 server_base.cc:1034] running on GCE node
W20260809 15:45:04.105027 12929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:04.105027 12924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:04.105997 12918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:04.107299 12918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:04.108517 12918 hybrid_clock.cc:648] HybridClock initialized: now 1786290304108505 us; error 27 us; skew 500 ppm
Aug 09 15:45:04 dist-test-slave-jztv krb5kdc[12901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:04.111478 12918 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:04.112404 12918 webserver.cc:460] Webserver started at http://127.0.0.1:32911/ using document root <none> and password file <none>
I20260809 15:45:04.113055 12918 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:04.113149 12918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:04.113389 12918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:04.115566 12918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "328751ee822a463aa1377a8ef3f12441"
format_stamp: "Formatted at 2026-08-09 15:45:04 on dist-test-slave-jztv"
server_key: "b6965f256b85146ff439f223ba821ea1"
server_key_iv: "d68ba158f4914ccc2fa5a52717b38417"
server_key_version: "encryptionkey@0"
I20260809 15:45:04.116236 12918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "328751ee822a463aa1377a8ef3f12441"
format_stamp: "Formatted at 2026-08-09 15:45:04 on dist-test-slave-jztv"
server_key: "b6965f256b85146ff439f223ba821ea1"
server_key_iv: "d68ba158f4914ccc2fa5a52717b38417"
server_key_version: "encryptionkey@0"
I20260809 15:45:04.120190 12918 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:45:04.122949 12939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:04.124301 12918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:04.124490 12918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "328751ee822a463aa1377a8ef3f12441"
format_stamp: "Formatted at 2026-08-09 15:45:04 on dist-test-slave-jztv"
server_key: "b6965f256b85146ff439f223ba821ea1"
server_key_iv: "d68ba158f4914ccc2fa5a52717b38417"
server_key_version: "encryptionkey@0"
I20260809 15:45:04.124620 12918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:04.166653 12918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:04.169957 12918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:04.170197 12918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:04.177670 12918 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34181
I20260809 15:45:04.177693 13026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34181 every 8 connection(s)
I20260809 15:45:04.178653 12918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:04.181404 13027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:04.184037 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 12918
I20260809 15:45:04.184211 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:04.184533 14398 external_mini_cluster.cc:1428] Setting key 9cbc750f41af3e45de13d80990a8348b
I20260809 15:45:04.187734 13027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441: Bootstrap starting.
I20260809 15:45:04.190409 13027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:04.191187 13027 log.cc:824] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:04.193209 13027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441: No bootstrap required, opened a new log
Aug 09 15:45:04 dist-test-slave-jztv krb5kdc[12901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:45:04.196717 13027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } }
I20260809 15:45:04.197016 13027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:04.197103 13027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 328751ee822a463aa1377a8ef3f12441, State: Initialized, Role: FOLLOWER
I20260809 15:45:04.197562 13027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } }
I20260809 15:45:04.197693 13027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:04.197777 13027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:04.197899 13027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:04.198879 13027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } }
I20260809 15:45:04.199293 13027 leader_election.cc:302] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 328751ee822a463aa1377a8ef3f12441; no voters:
I20260809 15:45:04.199678 13027 leader_election.cc:288] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:04.199797 13033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:04.200069 13033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [term 1 LEADER]: Becoming Leader. State: Replica: 328751ee822a463aa1377a8ef3f12441, State: Running, Role: LEADER
I20260809 15:45:04.200419 13033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } }
I20260809 15:45:04.201067 13027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:04.202117 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:04.185941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:32901 (local address 127.0.0.1:34181)
0809 15:45:04.186397 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:04.186416 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:04.186465 (+ 49us) server_negotiation.cc:407] Connection header received
0809 15:45:04.187290 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:04.187314 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:04.187735 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:04.188092 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:04.188933 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:04.190469 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:04.191409 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:04.192115 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:04.192288 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:04.195254 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:04.195259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:04.195273 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:04.195300 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:04.198006 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:04.198601 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:04.198607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:04.198613 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:04.198738 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:04.199135 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:04.199138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:04.199140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:04.199732 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:04.200699 (+ 967us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:04.200877 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 15:45:04.201123 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":109,"threads_started":1}
I20260809 15:45:04.202322 13034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "328751ee822a463aa1377a8ef3f12441" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } } }
I20260809 15:45:04.202322 13035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 328751ee822a463aa1377a8ef3f12441. Latest consensus state: current_term: 1 leader_uuid: "328751ee822a463aa1377a8ef3f12441" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328751ee822a463aa1377a8ef3f12441" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34181 } } }
I20260809 15:45:04.202484 13035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:04.202484 13034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:04.202908 13044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:04.205888 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:04.206332 13044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:04.214708 13044 catalog_manager.cc:1347] Generated new cluster ID: 716d32438f1c464f94618fa949ec5c03
I20260809 15:45:04.214781 13044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:04.221372 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:04.208416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:33503 (local address 127.0.0.1:34181)
0809 15:45:04.208519 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:04.208525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:04.212966 (+ 4441us) server_negotiation.cc:407] Connection header received
0809 15:45:04.213066 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:04.213069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:04.213132 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:04.213195 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:04.214317 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:04.215058 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:04.215893 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:04.216155 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:04.216271 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:04.217863 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:04.217866 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:04.217869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:04.217896 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:04.219503 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:04.220009 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:04.220013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:04.220015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:04.220100 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:04.220450 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:04.220453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:04.220455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:04.220632 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:04.220791 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:04.221081 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 15:45:04.221179 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 15:45:04.232245 13044 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:04.233211 13044 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:04.240717 13044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 328751ee822a463aa1377a8ef3f12441: Generated new TSK 0
I20260809 15:45:04.241423 13044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:04.250535 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 12918
W20260809 15:45:04.266619 12896 connection.cc:535] client connection to 127.0.0.1:34181 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34181): Connection reset by peer (error 104)
2026-08-09T15:45:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1652 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:04 dist-test-slave-jztv krb5kdc[13070](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:04 dist-test-slave-jztv krb5kdc[13070](info): set up 2 sockets
Aug 09 15:45:04 dist-test-slave-jztv krb5kdc[13070](info): commencing operation
krb5kdc: starting...
W20260809 15:45:05.487321 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:05 dist-test-slave-jztv krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:05.621570 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:05.736052 13093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:05.736373 13093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:05.736449 13093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:05.740568 13093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:05.740653 13093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:05.740700 13093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:05.740757 13093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:05.740797 13093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:05.745994 13093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:05.747107 13093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:05.748162 13093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:45:05.756994 13093 server_base.cc:1034] running on GCE node
W20260809 15:45:05.756949 13101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:05.756956 13100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:05.756954 13105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:05.757905 13093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:05.759176 13093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:05.760390 13093 hybrid_clock.cc:648] HybridClock initialized: now 1786290305760342 us; error 52 us; skew 500 ppm
Aug 09 15:45:05 dist-test-slave-jztv krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290305, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:05.766553 13093 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:05.767570 13093 webserver.cc:460] Webserver started at http://127.0.0.1:37715/ using document root <none> and password file <none>
I20260809 15:45:05.768141 13093 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:05.768204 13093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:05.768474 13093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:05.770624 13093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af"
format_stamp: "Formatted at 2026-08-09 15:45:05 on dist-test-slave-jztv"
server_key: "cb3feef8695de65972f0aa9299c44624"
server_key_iv: "cafcda86eed9bfb6a3d20922ca1b658a"
server_key_version: "encryptionkey@0"
I20260809 15:45:05.771198 13093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af"
format_stamp: "Formatted at 2026-08-09 15:45:05 on dist-test-slave-jztv"
server_key: "cb3feef8695de65972f0aa9299c44624"
server_key_iv: "cafcda86eed9bfb6a3d20922ca1b658a"
server_key_version: "encryptionkey@0"
I20260809 15:45:05.775005 13093 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:45:05.777438 13113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:05.778777 13093 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 15:45:05.778915 13093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af"
format_stamp: "Formatted at 2026-08-09 15:45:05 on dist-test-slave-jztv"
server_key: "cb3feef8695de65972f0aa9299c44624"
server_key_iv: "cafcda86eed9bfb6a3d20922ca1b658a"
server_key_version: "encryptionkey@0"
I20260809 15:45:05.779027 13093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:05.799059 13093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:05.802053 13093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:05.802289 13093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:05.809834 13093 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46627
I20260809 15:45:05.809863 13205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46627 every 8 connection(s)
I20260809 15:45:05.810969 13093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:05.813776 13208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:05.819427 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13093
I20260809 15:45:05.819590 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:05.819875 13208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af: Bootstrap starting.
I20260809 15:45:05.819916 14398 external_mini_cluster.cc:1428] Setting key e115c4d24377cc7358da80b8b3ee6c0e
I20260809 15:45:05.822743 13208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:05.823530 13208 log.cc:824] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:05.825521 13208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af: No bootstrap required, opened a new log
I20260809 15:45:05.829492 13213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:05.821409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:60601 (local address 127.0.0.1:46627)
0809 15:45:05.821885 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:05.821914 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:05.821951 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:45:05.822712 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:05.822731 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:05.823136 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:05.823483 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:05.823886 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:05.825051 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:05.826012 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:05.826543 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:05.826710 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:05.827769 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:05.827774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:05.827787 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:05.828185 (+ 398us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:05.828238 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:05.828261 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:05.828421 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:05.828624 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 15:45:05.828767 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":147,"threads_started":1}
I20260809 15:45:05.829522 13208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } }
I20260809 15:45:05.829873 13208 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:05.829928 13208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7df4b9ac0446bbb2cfbc12213fb8af, State: Initialized, Role: FOLLOWER
I20260809 15:45:05.830415 13208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } }
I20260809 15:45:05.830587 13208 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:05.830677 13208 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:05.830783 13208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:05.831960 13208 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } }
I20260809 15:45:05.832379 13208 leader_election.cc:302] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d7df4b9ac0446bbb2cfbc12213fb8af; no voters:
I20260809 15:45:05.832742 13208 leader_election.cc:288] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:05.832808 13215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:05.832819 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:05.833031 13215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [term 1 LEADER]: Becoming Leader. State: Replica: 9d7df4b9ac0446bbb2cfbc12213fb8af, State: Running, Role: LEADER
I20260809 15:45:05.833402 13215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } }
I20260809 15:45:05.834076 13208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:05.835194 13216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } } }
I20260809 15:45:05.835330 13216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:05.835646 13219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d7df4b9ac0446bbb2cfbc12213fb8af. Latest consensus state: current_term: 1 leader_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7df4b9ac0446bbb2cfbc12213fb8af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46627 } } }
I20260809 15:45:05.835745 13219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:05.836683 13239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:05.839895 13213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:05.835327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:58091 (local address 127.0.0.1:46627)
0809 15:45:05.835436 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:05.835441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:05.835710 (+ 269us) server_negotiation.cc:407] Connection header received
0809 15:45:05.835885 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:05.835888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:05.835937 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:05.835992 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:05.836434 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:05.837228 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:05.838060 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:05.838379 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:05.838487 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:05.839386 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:05.839390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:05.839393 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:05.839407 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:05.839439 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:05.839450 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:05.839552 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:05.839694 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 15:45:05.839728 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:45:05.840186 13239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:05.846791 13239 catalog_manager.cc:1347] Generated new cluster ID: 335047bba39e4aa8b426d35e4e9b2d5a
I20260809 15:45:05.846884 13239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:05.868396 13239 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:05.869784 13239 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:05.876955 13239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d7df4b9ac0446bbb2cfbc12213fb8af: Generated new TSK 0
I20260809 15:45:05.877836 13239 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:05.882962 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13093
W20260809 15:45:05.893708 13067 connection.cc:535] client connection to 127.0.0.1:46627 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46627): Connection reset by peer (error 104)
2026-08-09T15:45:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1626 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:05 dist-test-slave-jztv krb5kdc[13258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:05 dist-test-slave-jztv krb5kdc[13258](info): set up 2 sockets
Aug 09 15:45:05 dist-test-slave-jztv krb5kdc[13258](info): commencing operation
krb5kdc: starting...
W20260809 15:45:07.123263 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:07 dist-test-slave-jztv krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:07.273576 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44019
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:07.391901 13282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:07.392220 13282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:07.392297 13282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:07.396353 13282 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:07.396445 13282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:07.396492 13282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:07.396551 13282 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:07.396591 13282 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:07.401929 13282 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:07.403025 13282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:07.404026 13282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:45:07.412911 13282 server_base.cc:1034] running on GCE node
W20260809 15:45:07.412858 13294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:07.412894 13292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:07.412858 13291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:07.413726 13282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:07.414958 13282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:07.416141 13282 hybrid_clock.cc:648] HybridClock initialized: now 1786290307416107 us; error 43 us; skew 500 ppm
Aug 09 15:45:07 dist-test-slave-jztv krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290307, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:07.418962 13282 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:07.419945 13282 webserver.cc:460] Webserver started at http://127.0.0.1:33727/ using document root <none> and password file <none>
I20260809 15:45:07.420480 13282 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:07.420538 13282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:07.420708 13282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:07.422922 13282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "730d63f82d9a4b81acb40243aa46a2ee"
format_stamp: "Formatted at 2026-08-09 15:45:07 on dist-test-slave-jztv"
server_key: "b27bdf888e43bebb954188e972f6c25e"
server_key_iv: "5b50b3aa6c6249a64aa04e1fd59506b4"
server_key_version: "encryptionkey@0"
I20260809 15:45:07.423470 13282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "730d63f82d9a4b81acb40243aa46a2ee"
format_stamp: "Formatted at 2026-08-09 15:45:07 on dist-test-slave-jztv"
server_key: "b27bdf888e43bebb954188e972f6c25e"
server_key_iv: "5b50b3aa6c6249a64aa04e1fd59506b4"
server_key_version: "encryptionkey@0"
I20260809 15:45:07.427373 13282 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 15:45:07.429896 13307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:07.431259 13282 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:07.431413 13282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "730d63f82d9a4b81acb40243aa46a2ee"
format_stamp: "Formatted at 2026-08-09 15:45:07 on dist-test-slave-jztv"
server_key: "b27bdf888e43bebb954188e972f6c25e"
server_key_iv: "5b50b3aa6c6249a64aa04e1fd59506b4"
server_key_version: "encryptionkey@0"
I20260809 15:45:07.431535 13282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:07.436571 13282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:07.439949 13282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:07.440165 13282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:07.447968 13282 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44019
I20260809 15:45:07.447980 13381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44019 every 8 connection(s)
I20260809 15:45:07.448979 13282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:07.452126 13384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:07.452646 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13282
I20260809 15:45:07.452809 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:07.453122 14398 external_mini_cluster.cc:1428] Setting key 9851f5a2a4699491bf6ba2c358dce874
I20260809 15:45:07.458546 13390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:07.454591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:36501 (local address 127.0.0.1:44019)
0809 15:45:07.455032 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:07.455047 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:07.455084 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:45:07.455745 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:07.455763 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:07.456049 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:07.456336 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:07.457237 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:07.457242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:07.457253 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:07.457264 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:07.457320 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:07.457340 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:07.457454 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:07.457579 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 15:45:07.457774 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":138,"threads_started":1}
I20260809 15:45:07.458925 13384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee: Bootstrap starting.
I20260809 15:45:07.461453 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:07.461532 13384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:07.462430 13384 log.cc:824] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:07.464716 13384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee: No bootstrap required, opened a new log
I20260809 15:45:07.465408 13390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:07.463711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:35895 (local address 127.0.0.1:44019)
0809 15:45:07.463843 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:07.463850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:07.464039 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:45:07.464135 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:07.464138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:07.464174 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:07.464253 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:07.465018 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:07.465021 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:07.465024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:07.465036 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:07.465068 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:07.465081 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:07.465179 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:07.465252 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 15:45:07.465293 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:45:07.468876 13384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } }
I20260809 15:45:07.469115 13384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:07.469151 13384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 730d63f82d9a4b81acb40243aa46a2ee, State: Initialized, Role: FOLLOWER
I20260809 15:45:07.469530 13384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } }
I20260809 15:45:07.469645 13384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:07.469689 13384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:07.469760 13384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:07.470809 13384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } }
I20260809 15:45:07.471120 13384 leader_election.cc:302] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 730d63f82d9a4b81acb40243aa46a2ee; no voters:
I20260809 15:45:07.471444 13384 leader_election.cc:288] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:07.471517 13402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:07.471735 13402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [term 1 LEADER]: Becoming Leader. State: Replica: 730d63f82d9a4b81acb40243aa46a2ee, State: Running, Role: LEADER
I20260809 15:45:07.472054 13402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } }
I20260809 15:45:07.472822 13384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:07.473919 13404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "730d63f82d9a4b81acb40243aa46a2ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } } }
I20260809 15:45:07.474050 13404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:07.474505 13414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:07.474444 13405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 730d63f82d9a4b81acb40243aa46a2ee. Latest consensus state: current_term: 1 leader_uuid: "730d63f82d9a4b81acb40243aa46a2ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "730d63f82d9a4b81acb40243aa46a2ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44019 } } }
I20260809 15:45:07.475531 13405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:07.478127 13414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:07.485448 13414 catalog_manager.cc:1347] Generated new cluster ID: 0ace2d9b58a94cec899a1db8c3c19068
I20260809 15:45:07.485558 13414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:07.501180 13414 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:07.501559 13414 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:07.511830 13414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 730d63f82d9a4b81acb40243aa46a2ee: Generated new TSK 0
I20260809 15:45:07.512723 13414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:07.518385 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13282
2026-08-09T15:45:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1641 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:07 dist-test-slave-jztv krb5kdc[13428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:07 dist-test-slave-jztv krb5kdc[13428](info): set up 2 sockets
Aug 09 15:45:07 dist-test-slave-jztv krb5kdc[13428](info): commencing operation
krb5kdc: starting...
W20260809 15:45:08.773018 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:08 dist-test-slave-jztv krb5kdc[13428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:08.910121 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:09.024219 13446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:09.024554 13446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:09.024632 13446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:09.028795 13446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:09.028891 13446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:09.028928 13446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:09.028968 13446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:09.029004 13446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:09.034482 13446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37069
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:09.035696 13446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:09.036774 13446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:09.046010 13458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:09.045969 13454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:09.046087 13461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:09.046131 13446 server_base.cc:1034] running on GCE node
I20260809 15:45:09.047014 13446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:09.048202 13446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:09.049405 13446 hybrid_clock.cc:648] HybridClock initialized: now 1786290309049391 us; error 27 us; skew 500 ppm
Aug 09 15:45:09 dist-test-slave-jztv krb5kdc[13428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290309, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:09.052445 13446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:09.053414 13446 webserver.cc:460] Webserver started at http://127.0.0.1:40581/ using document root <none> and password file <none>
I20260809 15:45:09.054005 13446 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:09.054101 13446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:09.054409 13446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:09.056558 13446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "32b937a3b885424ebee14ca3cf5fb79a"
format_stamp: "Formatted at 2026-08-09 15:45:09 on dist-test-slave-jztv"
server_key: "7b2c728ba0dcbaf4bda8a0d1d8f93647"
server_key_iv: "a0518c9eae48fa17d1a3e3dcd763fe1b"
server_key_version: "encryptionkey@0"
I20260809 15:45:09.057178 13446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "32b937a3b885424ebee14ca3cf5fb79a"
format_stamp: "Formatted at 2026-08-09 15:45:09 on dist-test-slave-jztv"
server_key: "7b2c728ba0dcbaf4bda8a0d1d8f93647"
server_key_iv: "a0518c9eae48fa17d1a3e3dcd763fe1b"
server_key_version: "encryptionkey@0"
I20260809 15:45:09.061123 13446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:45:09.063724 13470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:09.065012 13446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:45:09.065176 13446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "32b937a3b885424ebee14ca3cf5fb79a"
format_stamp: "Formatted at 2026-08-09 15:45:09 on dist-test-slave-jztv"
server_key: "7b2c728ba0dcbaf4bda8a0d1d8f93647"
server_key_iv: "a0518c9eae48fa17d1a3e3dcd763fe1b"
server_key_version: "encryptionkey@0"
I20260809 15:45:09.065299 13446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:09.101632 13446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:09.104919 13446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:09.105158 13446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:09.113050 13446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37069
I20260809 15:45:09.113077 13548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37069 every 8 connection(s)
I20260809 15:45:09.114092 13446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:09.117057 13549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:09.118311 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13446
I20260809 15:45:09.118467 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:09.118785 14398 external_mini_cluster.cc:1428] Setting key 510658a18af690de97828afbf2d31c6d
I20260809 15:45:09.123335 13549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: Bootstrap starting.
I20260809 15:45:09.125586 13549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:09.126526 13549 log.cc:824] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:45:09 dist-test-slave-jztv krb5kdc[13428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:45:09.128993 13549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: No bootstrap required, opened a new log
I20260809 15:45:09.133451 13549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260809 15:45:09.133642 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:09.120336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:54553 (local address 127.0.0.1:37069)
0809 15:45:09.120800 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:09.120815 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:09.120853 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:45:09.121502 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:09.121519 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:09.121858 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:09.122201 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:09.123077 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:09.124111 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:09.124996 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:09.125473 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:09.125649 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:09.128746 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:09.128752 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:09.128765 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:09.128793 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:09.130558 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:09.131167 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:09.131172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:09.131177 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:09.131289 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:09.131665 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:09.131667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:09.131668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:09.132067 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:09.132245 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:09.132594 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 15:45:09.132853 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":143,"threads_started":1}
I20260809 15:45:09.133682 13549 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:09.133800 13549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b937a3b885424ebee14ca3cf5fb79a, State: Initialized, Role: FOLLOWER
I20260809 15:45:09.134335 13549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260809 15:45:09.134500 13549 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:09.134588 13549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:09.134702 13549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:09.135682 13549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260809 15:45:09.136036 13549 leader_election.cc:302] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32b937a3b885424ebee14ca3cf5fb79a; no voters:
I20260809 15:45:09.136381 13549 leader_election.cc:288] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:09.136488 13558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:09.136705 13558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [term 1 LEADER]: Becoming Leader. State: Replica: 32b937a3b885424ebee14ca3cf5fb79a, State: Running, Role: LEADER
I20260809 15:45:09.137043 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:09.137074 13558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260809 15:45:09.137758 13549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:09.138783 13561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32b937a3b885424ebee14ca3cf5fb79a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } } }
I20260809 15:45:09.138932 13561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:09.139118 13560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32b937a3b885424ebee14ca3cf5fb79a. Latest consensus state: current_term: 1 leader_uuid: "32b937a3b885424ebee14ca3cf5fb79a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b937a3b885424ebee14ca3cf5fb79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } } }
I20260809 15:45:09.139314 13560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a [sys.catalog]: This master's current role is: LEADER
W20260809 15:45:09.143134 13585 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:09.143220 13585 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:09.143292 13578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:09.144196 13578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:09.149204 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:09.139829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:43497 (local address 127.0.0.1:37069)
0809 15:45:09.139951 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:09.139955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:09.140596 (+ 641us) server_negotiation.cc:407] Connection header received
0809 15:45:09.140722 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:09.140725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:09.140775 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:09.140868 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:09.141510 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:09.142289 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:09.143472 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:09.143784 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:09.143899 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:09.145685 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:09.145689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:09.145692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:09.145719 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:09.147298 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:09.147810 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:09.147814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:09.147816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:09.147901 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:09.148242 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:09.148246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:09.148247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:09.148476 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:09.148630 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:09.148913 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 15:45:09.148999 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:45:09.151544 13578 catalog_manager.cc:1347] Generated new cluster ID: 1bb174ccd9494abf997d1d9984260fcf
I20260809 15:45:09.151611 13578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:09.162977 13578 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:09.164233 13578 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:09.179508 13578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32b937a3b885424ebee14ca3cf5fb79a: Generated new TSK 0
I20260809 15:45:09.180379 13578 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:09.193795 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13446
W20260809 15:45:09.206163 13426 connection.cc:535] client connection to 127.0.0.1:37069 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37069): Connection reset by peer (error 104)
2026-08-09T15:45:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1671 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:09 dist-test-slave-jztv krb5kdc[13600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:09 dist-test-slave-jztv krb5kdc[13600](info): set up 2 sockets
Aug 09 15:45:09 dist-test-slave-jztv krb5kdc[13600](info): commencing operation
krb5kdc: starting...
W20260809 15:45:10.430927 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:10 dist-test-slave-jztv krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:10.567809 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:10.682859 13616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:10.683161 13616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:10.683231 13616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:10.687357 13616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:10.687443 13616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:10.687484 13616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:10.687542 13616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:10.687584 13616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:10.692777 13616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37315
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:10.693835 13616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:10.694870 13616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:10.703909 13627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:10.703927 13625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:10.704059 13616 server_base.cc:1034] running on GCE node
W20260809 15:45:10.703943 13624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:10.704846 13616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:10.705904 13616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:10.707072 13616 hybrid_clock.cc:648] HybridClock initialized: now 1786290310707053 us; error 31 us; skew 500 ppm
Aug 09 15:45:10 dist-test-slave-jztv krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290310, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:10.709857 13616 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:10.710790 13616 webserver.cc:460] Webserver started at http://127.0.0.1:45037/ using document root <none> and password file <none>
I20260809 15:45:10.711297 13616 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:10.711355 13616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:10.711525 13616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:10.713538 13616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0"
format_stamp: "Formatted at 2026-08-09 15:45:10 on dist-test-slave-jztv"
server_key: "0620c4358e43422fe7e13cbc15c00200"
server_key_iv: "eed2e3e2c7c13f0118dc6ef4968a97c8"
server_key_version: "encryptionkey@0"
I20260809 15:45:10.714113 13616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0"
format_stamp: "Formatted at 2026-08-09 15:45:10 on dist-test-slave-jztv"
server_key: "0620c4358e43422fe7e13cbc15c00200"
server_key_iv: "eed2e3e2c7c13f0118dc6ef4968a97c8"
server_key_version: "encryptionkey@0"
I20260809 15:45:10.717825 13616 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:10.720361 13638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:10.721675 13616 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:45:10.721802 13616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0"
format_stamp: "Formatted at 2026-08-09 15:45:10 on dist-test-slave-jztv"
server_key: "0620c4358e43422fe7e13cbc15c00200"
server_key_iv: "eed2e3e2c7c13f0118dc6ef4968a97c8"
server_key_version: "encryptionkey@0"
I20260809 15:45:10.721912 13616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:10.757238 13616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:10.760689 13616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:10.760906 13616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:10.768486 13616 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37315
I20260809 15:45:10.768484 13728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37315 every 8 connection(s)
I20260809 15:45:10.769464 13616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:10.772179 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:10.775420 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13616
I20260809 15:45:10.775592 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:10.775900 14398 external_mini_cluster.cc:1428] Setting key 2c0aee1fa4696805cdcb16963fea282a
I20260809 15:45:10.778247 13729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0: Bootstrap starting.
I20260809 15:45:10.780441 13729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:10.781186 13729 log.cc:824] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:10.783245 13729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0: No bootstrap required, opened a new log
I20260809 15:45:10.786835 13729 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } }
I20260809 15:45:10.787099 13729 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:10.787194 13729 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad53a548e03d46fc8b1abdf6c8c3e9e0, State: Initialized, Role: FOLLOWER
I20260809 15:45:10.787678 13729 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } }
I20260809 15:45:10.787832 13729 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:10.787920 13729 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:10.788033 13729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:10.788954 13729 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } }
I20260809 15:45:10.789304 13729 leader_election.cc:302] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad53a548e03d46fc8b1abdf6c8c3e9e0; no voters:
I20260809 15:45:10.789647 13729 leader_election.cc:288] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:10.789817 13737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:10.790102 13737 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [term 1 LEADER]: Becoming Leader. State: Replica: ad53a548e03d46fc8b1abdf6c8c3e9e0, State: Running, Role: LEADER
I20260809 15:45:10.790562 13737 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } }
I20260809 15:45:10.791079 13729 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:10.792412 13740 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad53a548e03d46fc8b1abdf6c8c3e9e0. Latest consensus state: current_term: 1 leader_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } } }
I20260809 15:45:10.792615 13740 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:10.792775 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:10.777362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:33193 (local address 127.0.0.1:37315)
0809 15:45:10.777809 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:10.777824 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:10.777859 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:45:10.778609 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:10.778628 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:10.778957 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:10.779274 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:10.779711 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:10.780760 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:10.781718 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:10.782190 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:10.782422 (+ 232us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:10.790529 (+ 8107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:10.790536 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:10.790552 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:10.791051 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:10.791130 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:10.791167 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:10.791314 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:10.791552 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 15:45:10.791696 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":128,"threads_started":1}
I20260809 15:45:10.793179 13738 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad53a548e03d46fc8b1abdf6c8c3e9e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37315 } } }
I20260809 15:45:10.794185 13738 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:10.793112 13755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:10.796271 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:10.797478 13755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:10.803649 13755 catalog_manager.cc:1347] Generated new cluster ID: cd56d4eb5e7c4704a33fac508ab40f2c
I20260809 15:45:10.803725 13755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:10.807112 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:10.798277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:42183 (local address 127.0.0.1:37315)
0809 15:45:10.798389 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:10.798394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:10.799875 (+ 1481us) server_negotiation.cc:407] Connection header received
0809 15:45:10.800024 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:10.800027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:10.800078 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:10.800166 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:10.800498 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:10.801256 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:10.802610 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:10.802945 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:10.803053 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:10.806596 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:10.806599 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:10.806601 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:10.806614 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:10.806637 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:10.806648 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:10.806747 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:10.806914 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 15:45:10.806960 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:45:10.816591 13755 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:10.817560 13755 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:10.832144 13755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad53a548e03d46fc8b1abdf6c8c3e9e0: Generated new TSK 0
I20260809 15:45:10.832978 13755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:10.844655 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13616
W20260809 15:45:10.858944 13594 connection.cc:535] client connection to 127.0.0.1:37315 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37315): Connection reset by peer (error 104)
2026-08-09T15:45:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:10 dist-test-slave-jztv krb5kdc[13775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:10 dist-test-slave-jztv krb5kdc[13775](info): set up 2 sockets
Aug 09 15:45:10 dist-test-slave-jztv krb5kdc[13775](info): commencing operation
krb5kdc: starting...
W20260809 15:45:12.074486 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:12 dist-test-slave-jztv krb5kdc[13775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:45:12.214166 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:12.330950 13796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:12.331243 13796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:12.331326 13796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:12.335341 13796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:12.335434 13796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:12.335479 13796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:12.335516 13796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:12.335547 13796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:12.340853 13796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:12.341933 13796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:12.342998 13796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:12.351675 13803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:12.351675 13810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:12.351707 13804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:12.351945 13796 server_base.cc:1034] running on GCE node
I20260809 15:45:12.352560 13796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:12.353652 13796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:12.354853 13796 hybrid_clock.cc:648] HybridClock initialized: now 1786290312354833 us; error 33 us; skew 500 ppm
Aug 09 15:45:12 dist-test-slave-jztv krb5kdc[13775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290312, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:12.357625 13796 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:45:12.358605 13796 webserver.cc:460] Webserver started at http://127.0.0.1:39139/ using document root <none> and password file <none>
I20260809 15:45:12.359163 13796 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:12.359254 13796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:12.359511 13796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:12.361526 13796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "ffbfb650f3a54e3ea54339e6e41283b7"
format_stamp: "Formatted at 2026-08-09 15:45:12 on dist-test-slave-jztv"
server_key: "ea3be3a26f7289de213f0e1d9584c5e7"
server_key_iv: "51b5f087078f63133f726db3ce8d7784"
server_key_version: "encryptionkey@0"
I20260809 15:45:12.362099 13796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "ffbfb650f3a54e3ea54339e6e41283b7"
format_stamp: "Formatted at 2026-08-09 15:45:12 on dist-test-slave-jztv"
server_key: "ea3be3a26f7289de213f0e1d9584c5e7"
server_key_iv: "51b5f087078f63133f726db3ce8d7784"
server_key_version: "encryptionkey@0"
I20260809 15:45:12.365849 13796 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:45:12.368345 13820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:12.369640 13796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:45:12.369791 13796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "ffbfb650f3a54e3ea54339e6e41283b7"
format_stamp: "Formatted at 2026-08-09 15:45:12 on dist-test-slave-jztv"
server_key: "ea3be3a26f7289de213f0e1d9584c5e7"
server_key_iv: "51b5f087078f63133f726db3ce8d7784"
server_key_version: "encryptionkey@0"
I20260809 15:45:12.369905 13796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:12.374444 13796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:12.377234 13796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:12.377445 13796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:12.384994 13796 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38405
I20260809 15:45:12.385008 13897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38405 every 8 connection(s)
I20260809 15:45:12.385890 13796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:12.388602 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:12.391510 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13796
I20260809 15:45:12.391651 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:12.391943 14398 external_mini_cluster.cc:1428] Setting key c011c9884558a3f40b152437bfaeefcd
I20260809 15:45:12.394670 13898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7: Bootstrap starting.
I20260809 15:45:12.397089 13901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:12.393260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:56885 (local address 127.0.0.1:38405)
0809 15:45:12.393664 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:12.393679 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:12.393713 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:45:12.394414 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:12.394432 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:12.394698 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:12.395019 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:12.395829 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:12.395834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:12.395846 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:12.395856 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:12.395912 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:12.395931 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:12.396037 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:12.396234 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 15:45:12.396433 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":131,"threads_started":1}
I20260809 15:45:12.397238 13898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:12.398000 13898 log.cc:824] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:12.399864 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:12.400009 13898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7: No bootstrap required, opened a new log
I20260809 15:45:12.403784 13901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:12.402091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.47:55479 (local address 127.0.0.1:38405)
0809 15:45:12.402231 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:12.402235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:12.402450 (+ 215us) server_negotiation.cc:407] Connection header received
0809 15:45:12.402522 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:12.402525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:12.402558 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:12.402640 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:12.403353 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:12.403359 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:12.403363 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:12.403381 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:12.403417 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:12.403433 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:12.403548 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:12.403608 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 15:45:12.403656 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:45:12.404665 13898 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260809 15:45:12.404953 13898 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:12.405010 13898 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffbfb650f3a54e3ea54339e6e41283b7, State: Initialized, Role: FOLLOWER
I20260809 15:45:12.405371 13898 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260809 15:45:12.405486 13898 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:12.405526 13898 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:12.405589 13898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:12.406618 13898 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260809 15:45:12.406992 13898 leader_election.cc:302] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffbfb650f3a54e3ea54339e6e41283b7; no voters:
I20260809 15:45:12.407341 13898 leader_election.cc:288] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:12.407476 13910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:12.407732 13910 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [term 1 LEADER]: Becoming Leader. State: Replica: ffbfb650f3a54e3ea54339e6e41283b7, State: Running, Role: LEADER
I20260809 15:45:12.408118 13910 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } }
I20260809 15:45:12.408598 13898 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:12.410007 13913 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffbfb650f3a54e3ea54339e6e41283b7. Latest consensus state: current_term: 1 leader_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } } }
I20260809 15:45:12.410053 13912 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb650f3a54e3ea54339e6e41283b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38405 } } }
I20260809 15:45:12.410140 13913 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:12.410156 13912 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:12.410647 13928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:12.413400 13928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:12.418566 13928 catalog_manager.cc:1347] Generated new cluster ID: 5e84be4f473c4974b09b9eebc561815b
I20260809 15:45:12.418639 13928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:12.434284 13928 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:12.434675 13928 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:12.440461 13928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffbfb650f3a54e3ea54339e6e41283b7: Generated new TSK 0
I20260809 15:45:12.441320 13928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:12.451761 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13796
2026-08-09T15:45:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1604 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:12 dist-test-slave-jztv krb5kdc[13948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:12 dist-test-slave-jztv krb5kdc[13948](info): set up 2 sockets
Aug 09 15:45:12 dist-test-slave-jztv krb5kdc[13948](info): commencing operation
krb5kdc: starting...
W20260809 15:45:13.720453 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:13 dist-test-slave-jztv krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:13.861169 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39841
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:34317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:39841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:13.976617 13965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:13.976882 13965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:13.976924 13965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:13.980945 13965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:13.981004 13965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:13.981024 13965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:13.981041 13965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:13.981056 13965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:13.986346 13965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:34317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:39841
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:39841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:13.987723 13965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:13.988739 13965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:13.997514 13975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:13.997529 13973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:13.997529 13972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:13.997599 13965 server_base.cc:1034] running on GCE node
I20260809 15:45:13.998451 13965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:13.999626 13965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:14.000833 13965 hybrid_clock.cc:648] HybridClock initialized: now 1786290314000796 us; error 51 us; skew 500 ppm
Aug 09 15:45:13 dist-test-slave-jztv krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290313, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:14.003921 13965 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:14.004832 13965 webserver.cc:460] Webserver started at http://127.14.15.190:41227/ using document root <none> and password file <none>
I20260809 15:45:14.005380 13965 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:14.005447 13965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:14.005626 13965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:14.007807 13965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "c331d112212445158291d4abe6db78fd"
format_stamp: "Formatted at 2026-08-09 15:45:13 on dist-test-slave-jztv"
server_key: "a397a84e35fd3bf1299c8d3f9ca6a441"
server_key_iv: "44a874f28d44d9587b7c5b23d87cd72f"
server_key_version: "encryptionkey@0"
I20260809 15:45:14.008376 13965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "c331d112212445158291d4abe6db78fd"
format_stamp: "Formatted at 2026-08-09 15:45:13 on dist-test-slave-jztv"
server_key: "a397a84e35fd3bf1299c8d3f9ca6a441"
server_key_iv: "44a874f28d44d9587b7c5b23d87cd72f"
server_key_version: "encryptionkey@0"
I20260809 15:45:14.012465 13965 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:45:14.015065 13983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:14.016436 13965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:14.016579 13965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "c331d112212445158291d4abe6db78fd"
format_stamp: "Formatted at 2026-08-09 15:45:13 on dist-test-slave-jztv"
server_key: "a397a84e35fd3bf1299c8d3f9ca6a441"
server_key_iv: "44a874f28d44d9587b7c5b23d87cd72f"
server_key_version: "encryptionkey@0"
I20260809 15:45:14.016700 13965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:14.044243 13965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:14.047950 13965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:14.048177 13965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:14.056048 13965 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:39841
I20260809 15:45:14.056082 14064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:39841 every 8 connection(s)
I20260809 15:45:14.057082 13965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:14.059639 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 13965
I20260809 15:45:14.059799 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:14.060132 14398 external_mini_cluster.cc:1428] Setting key 89bd82641fd711db03b6a715b68c8e6b
I20260809 15:45:14.060256 14066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:14.066743 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd: Bootstrap starting.
I20260809 15:45:14.068938 14066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd: Neither blocks nor log segments found. Creating new log.
Aug 09 15:45:14 dist-test-slave-jztv krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:14.069717 14066 log.cc:824] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:14.071875 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd: No bootstrap required, opened a new log
I20260809 15:45:14.075115 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:14.061649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34415 (local address 127.14.15.190:39841)
0809 15:45:14.062125 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:14.062140 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:14.062177 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:45:14.063149 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:14.063169 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:14.063535 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:14.063890 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:14.064757 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:14.065767 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:14.066753 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:14.067269 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:14.067443 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:14.070086 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:14.070094 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:14.070114 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:14.070148 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:14.071947 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:14.072635 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:14.072649 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:14.072654 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:14.072776 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:14.073156 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:14.073159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:14.073160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:14.073562 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:14.073723 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:14.074082 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 15:45:14.074348 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":157,"threads_started":1}
I20260809 15:45:14.076174 14066 raft_consensus.cc:348] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } }
I20260809 15:45:14.076459 14066 raft_consensus.cc:374] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:14.076511 14066 raft_consensus.cc:729] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c331d112212445158291d4abe6db78fd, State: Initialized, Role: FOLLOWER
I20260809 15:45:14.076969 14066 consensus_queue.cc:260] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } }
I20260809 15:45:14.077134 14066 raft_consensus.cc:388] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:14.077208 14066 raft_consensus.cc:482] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:14.077356 14066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:14.078203 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:14.078629 14066 raft_consensus.cc:504] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } }
I20260809 15:45:14.078984 14066 leader_election.cc:302] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c331d112212445158291d4abe6db78fd; no voters:
I20260809 15:45:14.079344 14066 leader_election.cc:288] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:14.079461 14076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:14.079706 14076 raft_consensus.cc:686] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [term 1 LEADER]: Becoming Leader. State: Replica: c331d112212445158291d4abe6db78fd, State: Running, Role: LEADER
I20260809 15:45:14.080039 14076 consensus_queue.cc:237] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } }
I20260809 15:45:14.080742 14066 sys_catalog.cc:564] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:14.081512 14084 sys_catalog.cc:455] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c331d112212445158291d4abe6db78fd. Latest consensus state: current_term: 1 leader_uuid: "c331d112212445158291d4abe6db78fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } } }
I20260809 15:45:14.081650 14084 sys_catalog.cc:458] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:14.082010 14083 sys_catalog.cc:455] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c331d112212445158291d4abe6db78fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c331d112212445158291d4abe6db78fd" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 39841 } } }
I20260809 15:45:14.082118 14083 sys_catalog.cc:458] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:14.082443 14097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:14.085707 14097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:14.092044 14097 catalog_manager.cc:1347] Generated new cluster ID: a422690b6e804ccda79a749e95428fc5
I20260809 15:45:14.092123 14097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:14.093060 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:14.080539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57695 (local address 127.14.15.190:39841)
0809 15:45:14.080645 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:14.080649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:14.081075 (+ 426us) server_negotiation.cc:407] Connection header received
0809 15:45:14.081238 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:14.081242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:14.081291 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:14.081347 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:14.082878 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:14.083612 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:14.084774 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:14.085135 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:14.085245 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:14.087037 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:14.087041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:14.087044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:14.087070 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:14.090904 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:14.091550 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:14.091554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:14.091556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:14.091642 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:14.092038 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:14.092042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:14.092044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:14.092311 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:14.092476 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:14.092796 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 15:45:14.092902 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:45:14.104727 14097 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:14.105989 14097 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:14.117619 14097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c331d112212445158291d4abe6db78fd: Generated new TSK 0
I20260809 15:45:14.118515 14097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:14.127696 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 13965
W20260809 15:45:14.145031 13944 connection.cc:535] client connection to 127.14.15.190:39841 recv error: Network error: failed to read from TLS socket (remote: 127.14.15.190:39841): Connection reset by peer (error 104)
2026-08-09T15:45:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1680 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:14 dist-test-slave-jztv krb5kdc[14123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:14 dist-test-slave-jztv krb5kdc[14123](info): set up 2 sockets
Aug 09 15:45:14 dist-test-slave-jztv krb5kdc[14123](info): commencing operation
krb5kdc: starting...
W20260809 15:45:15.372867 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:15 dist-test-slave-jztv krb5kdc[14123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:15.505954 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35007
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:45051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:15.618902 14141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:15.619179 14141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:15.619222 14141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:15.623205 14141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:15.623261 14141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:15.623281 14141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:15.623297 14141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:15.623312 14141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:15.628535 14141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:45051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35007
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:15.629505 14141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:15.630533 14141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:15.639014 14150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:15.639027 14152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:15.639032 14155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:15.639329 14141 server_base.cc:1034] running on GCE node
I20260809 15:45:15.639917 14141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:15.640981 14141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:15.642277 14141 hybrid_clock.cc:648] HybridClock initialized: now 1786290315642199 us; error 32 us; skew 500 ppm
Aug 09 15:45:15 dist-test-slave-jztv krb5kdc[14123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290315, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:15.645119 14141 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:15.646026 14141 webserver.cc:460] Webserver started at http://127.14.15.190:35997/ using document root <none> and password file <none>
I20260809 15:45:15.646649 14141 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:15.646744 14141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:15.646981 14141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:15.648974 14141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "8e481166caa24e8b827440f5cb142258"
format_stamp: "Formatted at 2026-08-09 15:45:15 on dist-test-slave-jztv"
server_key: "f4b4b0642ae94d877f4f16e1375ed9bd"
server_key_iv: "680906358a809b39543e7066a00f51a2"
server_key_version: "encryptionkey@0"
I20260809 15:45:15.649544 14141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "8e481166caa24e8b827440f5cb142258"
format_stamp: "Formatted at 2026-08-09 15:45:15 on dist-test-slave-jztv"
server_key: "f4b4b0642ae94d877f4f16e1375ed9bd"
server_key_iv: "680906358a809b39543e7066a00f51a2"
server_key_version: "encryptionkey@0"
I20260809 15:45:15.653239 14141 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:45:15.655668 14168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:15.656872 14141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:45:15.657018 14141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "8e481166caa24e8b827440f5cb142258"
format_stamp: "Formatted at 2026-08-09 15:45:15 on dist-test-slave-jztv"
server_key: "f4b4b0642ae94d877f4f16e1375ed9bd"
server_key_iv: "680906358a809b39543e7066a00f51a2"
server_key_version: "encryptionkey@0"
I20260809 15:45:15.657136 14141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:15.686659 14141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:15.689751 14141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:15.689980 14141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:15.697574 14141 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35007
I20260809 15:45:15.697590 14254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35007 every 8 connection(s)
I20260809 15:45:15.698571 14141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:15.701365 14255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:15.703557 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14141
I20260809 15:45:15.703711 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:15.704000 14398 external_mini_cluster.cc:1428] Setting key de9e9a4e00c367ad55653ccb1d74f397
I20260809 15:45:15.708083 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258: Bootstrap starting.
I20260809 15:45:15.710453 14255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:15.711196 14255 log.cc:824] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:15.713215 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258: No bootstrap required, opened a new log
I20260809 15:45:15.714483 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:15.705464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52427 (local address 127.14.15.190:35007)
0809 15:45:15.705886 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:15.705902 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:15.705940 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:45:15.706939 (+ 999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:15.706980 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:15.707525 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:15.707943 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:15.708420 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:15.709666 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:15.710821 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:15.711412 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:15.711612 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:15.712614 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:15.712628 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:15.712641 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:15.713057 (+ 416us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:15.713115 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:15.713139 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:15.713294 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:15.713497 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 15:45:15.713656 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":143,"threads_started":1}
I20260809 15:45:15.717442 14255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } }
I20260809 15:45:15.717633 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:15.717731 14255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:15.717815 14255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e481166caa24e8b827440f5cb142258, State: Initialized, Role: FOLLOWER
I20260809 15:45:15.718294 14255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } }
I20260809 15:45:15.718458 14255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:15.718555 14255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:15.718654 14255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:15.719738 14255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } }
I20260809 15:45:15.720134 14255 leader_election.cc:302] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e481166caa24e8b827440f5cb142258; no voters:
I20260809 15:45:15.720477 14255 leader_election.cc:288] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:15.720577 14272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:15.720749 14272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [term 1 LEADER]: Becoming Leader. State: Replica: 8e481166caa24e8b827440f5cb142258, State: Running, Role: LEADER
I20260809 15:45:15.721040 14272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } }
I20260809 15:45:15.721753 14255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:15.722265 14272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e481166caa24e8b827440f5cb142258. Latest consensus state: current_term: 1 leader_uuid: "8e481166caa24e8b827440f5cb142258" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } } }
I20260809 15:45:15.722394 14272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:15.723119 14275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e481166caa24e8b827440f5cb142258" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e481166caa24e8b827440f5cb142258" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35007 } } }
I20260809 15:45:15.723220 14275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:15.724349 14284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:15.724925 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:15.719957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48979 (local address 127.14.15.190:35007)
0809 15:45:15.720051 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:15.720054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:15.720422 (+ 368us) server_negotiation.cc:407] Connection header received
0809 15:45:15.720551 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:15.720555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:15.720601 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:15.720686 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:15.720993 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:15.721583 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:15.722726 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:15.723080 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:15.723161 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:15.724259 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:15.724263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:15.724265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:15.724277 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:15.724305 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:15.724319 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:15.724422 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:15.724768 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 15:45:15.724804 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 15:45:15.727360 14284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:15.732740 14284 catalog_manager.cc:1347] Generated new cluster ID: 0e963b4f719147f79592247d372ce208
I20260809 15:45:15.732810 14284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:15.740806 14284 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:15.741712 14284 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:15.750506 14284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e481166caa24e8b827440f5cb142258: Generated new TSK 0
I20260809 15:45:15.751362 14284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:15.760191 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14141
W20260809 15:45:15.776225 14119 connection.cc:535] client connection to 127.14.15.190:35007 recv error: Network error: failed to read from TLS socket (remote: 127.14.15.190:35007): Connection reset by peer (error 104)
2026-08-09T15:45:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:15 dist-test-slave-jztv krb5kdc[14309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:15 dist-test-slave-jztv krb5kdc[14309](info): set up 2 sockets
Aug 09 15:45:15 dist-test-slave-jztv krb5kdc[14309](info): commencing operation
krb5kdc: starting...
W20260809 15:45:17.027899 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:17 dist-test-slave-jztv krb5kdc[14309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:17.161757 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35649
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:35649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:17.275069 14331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:17.275398 14331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:17.275490 14331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:17.279639 14331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:17.279726 14331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:17.279764 14331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:17.279824 14331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:17.279865 14331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:17.285789 14331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:35649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:35649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:17.287364 14331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:17.288836 14331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:17.300581 14337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:17.300576 14338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:17.300856 14341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:17.301206 14331 server_base.cc:1034] running on GCE node
I20260809 15:45:17.301888 14331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:17.303138 14331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:17.306021 14331 hybrid_clock.cc:648] HybridClock initialized: now 1786290317305990 us; error 47 us; skew 500 ppm
Aug 09 15:45:17 dist-test-slave-jztv krb5kdc[14309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290317, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:17.309814 14331 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:17.311164 14331 webserver.cc:460] Webserver started at http://127.14.15.190:35845/ using document root <none> and password file <none>
I20260809 15:45:17.311971 14331 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:17.312103 14331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:17.312397 14331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:17.315508 14331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "22f50ad6266e4e83a7d0d569092fab79"
format_stamp: "Formatted at 2026-08-09 15:45:17 on dist-test-slave-jztv"
server_key: "072097ec1e6468b71a2482f7c7ea0337"
server_key_iv: "270ecab6564ec9d0e58d5c53ffd8d7e0"
server_key_version: "encryptionkey@0"
I20260809 15:45:17.316399 14331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "22f50ad6266e4e83a7d0d569092fab79"
format_stamp: "Formatted at 2026-08-09 15:45:17 on dist-test-slave-jztv"
server_key: "072097ec1e6468b71a2482f7c7ea0337"
server_key_iv: "270ecab6564ec9d0e58d5c53ffd8d7e0"
server_key_version: "encryptionkey@0"
I20260809 15:45:17.321151 14331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 15:45:17.324445 14353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:17.326049 14331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:45:17.326192 14331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "22f50ad6266e4e83a7d0d569092fab79"
format_stamp: "Formatted at 2026-08-09 15:45:17 on dist-test-slave-jztv"
server_key: "072097ec1e6468b71a2482f7c7ea0337"
server_key_iv: "270ecab6564ec9d0e58d5c53ffd8d7e0"
server_key_version: "encryptionkey@0"
I20260809 15:45:17.326356 14331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:17.332927 14331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:17.336702 14331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:17.336932 14331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:17.344640 14331 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:35649
I20260809 15:45:17.344666 14437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:35649 every 8 connection(s)
I20260809 15:45:17.345585 14331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:17.348457 14438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:17.348608 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14331
I20260809 15:45:17.348747 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:17.349048 14398 external_mini_cluster.cc:1428] Setting key 2d0abdc6344e429d300ea8ddedc0291d
I20260809 15:45:17.354576 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:17.350381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45759 (local address 127.14.15.190:35649)
0809 15:45:17.350819 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:17.350837 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:17.350879 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:45:17.351661 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:17.351685 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:17.352043 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:17.352413 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:17.353133 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:17.353139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:17.353152 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:17.353165 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:17.353226 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:17.353252 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:17.353388 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:17.353469 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 15:45:17.353645 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":126,"threads_started":1}
I20260809 15:45:17.356302 14438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79: Bootstrap starting.
I20260809 15:45:17.357402 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:17.358835 14438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:17.359764 14438 log.cc:824] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:17.361332 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:17.359535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58699 (local address 127.14.15.190:35649)
0809 15:45:17.359651 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:17.359654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:17.359917 (+ 263us) server_negotiation.cc:407] Connection header received
0809 15:45:17.360029 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:17.360031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:17.360061 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:17.360128 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:17.360919 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:17.360922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:17.360923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:17.360934 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:17.360957 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:17.360968 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:17.361040 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:17.361146 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 15:45:17.361178 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:45:17.362118 14438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79: No bootstrap required, opened a new log
I20260809 15:45:17.365676 14438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } }
I20260809 15:45:17.365908 14438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:17.365943 14438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f50ad6266e4e83a7d0d569092fab79, State: Initialized, Role: FOLLOWER
I20260809 15:45:17.366428 14438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } }
I20260809 15:45:17.366560 14438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:17.366609 14438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:17.366730 14438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:17.367808 14438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } }
I20260809 15:45:17.368119 14438 leader_election.cc:302] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22f50ad6266e4e83a7d0d569092fab79; no voters:
I20260809 15:45:17.368381 14438 leader_election.cc:288] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:17.368525 14459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:17.368808 14459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [term 1 LEADER]: Becoming Leader. State: Replica: 22f50ad6266e4e83a7d0d569092fab79, State: Running, Role: LEADER
I20260809 15:45:17.369120 14459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } }
I20260809 15:45:17.369690 14438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:17.370831 14462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22f50ad6266e4e83a7d0d569092fab79. Latest consensus state: current_term: 1 leader_uuid: "22f50ad6266e4e83a7d0d569092fab79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } } }
I20260809 15:45:17.370961 14462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:17.371460 14461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22f50ad6266e4e83a7d0d569092fab79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f50ad6266e4e83a7d0d569092fab79" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 35649 } } }
I20260809 15:45:17.371568 14461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:17.371655 14477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:17.374584 14477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:17.379891 14477 catalog_manager.cc:1347] Generated new cluster ID: 6373455bcdff43bf8b3449eba099679f
I20260809 15:45:17.379971 14477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:17.390938 14477 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:17.391292 14477 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:17.398082 14477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22f50ad6266e4e83a7d0d569092fab79: Generated new TSK 0
I20260809 15:45:17.398973 14477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:17.408522 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14331
2026-08-09T15:45:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1643 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:17 dist-test-slave-jztv krb5kdc[14489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:17 dist-test-slave-jztv krb5kdc[14489](info): set up 2 sockets
Aug 09 15:45:17 dist-test-slave-jztv krb5kdc[14489](info): commencing operation
krb5kdc: starting...
W20260809 15:45:18.649652 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:18 dist-test-slave-jztv krb5kdc[14489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:18.784977 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33803
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:46751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:18.904819 14512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:18.905149 14512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:18.905233 14512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:18.909312 14512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:18.909430 14512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:18.909473 14512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:18.909510 14512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:18.909541 14512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:18.914924 14512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:46751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:18.916056 14512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:18.917106 14512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:18.925901 14518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:18.925900 14519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:18.926241 14512 server_base.cc:1034] running on GCE node
W20260809 15:45:18.926282 14522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:18.926927 14512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:18.927983 14512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:18.929154 14512 hybrid_clock.cc:648] HybridClock initialized: now 1786290318929137 us; error 30 us; skew 500 ppm
Aug 09 15:45:18 dist-test-slave-jztv krb5kdc[14489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290318, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:18.931929 14512 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:18.932808 14512 webserver.cc:460] Webserver started at http://127.14.15.190:41383/ using document root <none> and password file <none>
I20260809 15:45:18.933382 14512 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:18.933475 14512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:18.933758 14512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:18.935863 14512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "cb90f9e851324681a5311e6d4966cfc0"
format_stamp: "Formatted at 2026-08-09 15:45:18 on dist-test-slave-jztv"
server_key: "64aeae096b29040d3eb9514d11b8d2bf"
server_key_iv: "28a4701364e50c8be2a11a746032342d"
server_key_version: "encryptionkey@0"
I20260809 15:45:18.936475 14512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "cb90f9e851324681a5311e6d4966cfc0"
format_stamp: "Formatted at 2026-08-09 15:45:18 on dist-test-slave-jztv"
server_key: "64aeae096b29040d3eb9514d11b8d2bf"
server_key_iv: "28a4701364e50c8be2a11a746032342d"
server_key_version: "encryptionkey@0"
I20260809 15:45:18.940241 14512 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:45:18.942679 14534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:18.943873 14512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:45:18.944020 14512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "cb90f9e851324681a5311e6d4966cfc0"
format_stamp: "Formatted at 2026-08-09 15:45:18 on dist-test-slave-jztv"
server_key: "64aeae096b29040d3eb9514d11b8d2bf"
server_key_iv: "28a4701364e50c8be2a11a746032342d"
server_key_version: "encryptionkey@0"
I20260809 15:45:18.944144 14512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:18.971982 14512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:18.975461 14512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:18.975687 14512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:18.983238 14512 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:33803
I20260809 15:45:18.983268 14608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:33803 every 8 connection(s)
I20260809 15:45:18.984185 14512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:18.986881 14609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:18.992228 14609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0: Bootstrap starting.
I20260809 15:45:18.992734 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14512
I20260809 15:45:18.992882 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:18.993180 14398 external_mini_cluster.cc:1428] Setting key 4e84842341032e2714937b673b92f895
I20260809 15:45:18.995013 14609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:18.995898 14609 log.cc:824] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:18.998484 14609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0: No bootstrap required, opened a new log
Aug 09 15:45:18 dist-test-slave-jztv krb5kdc[14489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:19.003122 14609 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } }
I20260809 15:45:19.003376 14609 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:19.003455 14609 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90f9e851324681a5311e6d4966cfc0, State: Initialized, Role: FOLLOWER
I20260809 15:45:19.003937 14609 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } }
I20260809 15:45:19.004092 14609 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:19.004182 14609 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:19.004282 14609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:19.005178 14609 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } }
I20260809 15:45:19.005540 14609 leader_election.cc:302] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb90f9e851324681a5311e6d4966cfc0; no voters:
I20260809 15:45:19.005905 14609 leader_election.cc:288] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:19.005977 14620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:19.006181 14620 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [term 1 LEADER]: Becoming Leader. State: Replica: cb90f9e851324681a5311e6d4966cfc0, State: Running, Role: LEADER
I20260809 15:45:19.006554 14620 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } }
I20260809 15:45:19.007221 14609 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:19.007725 14620 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb90f9e851324681a5311e6d4966cfc0. Latest consensus state: current_term: 1 leader_uuid: "cb90f9e851324681a5311e6d4966cfc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } } }
I20260809 15:45:19.007895 14620 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:19.008371 14629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:19.008296 14621 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb90f9e851324681a5311e6d4966cfc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb90f9e851324681a5311e6d4966cfc0" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33803 } } }
I20260809 15:45:19.008558 14621 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:19.008980 14616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:18.994591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47011 (local address 127.14.15.190:33803)
0809 15:45:18.995027 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:18.995049 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:18.995092 (+ 43us) server_negotiation.cc:407] Connection header received
0809 15:45:18.995962 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:18.995988 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:18.996403 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:18.996756 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:18.997592 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:18.998709 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:18.999901 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:19.000367 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:19.000493 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:19.003430 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:19.003438 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:19.003457 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:19.003494 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:19.005440 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:19.005955 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:19.005963 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:19.005971 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:19.006152 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:19.006560 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:19.006563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:19.006565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:19.007021 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:19.007249 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:19.007545 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 15:45:19.007866 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":120,"threads_started":1}
I20260809 15:45:19.011724 14629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:19.012151 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:19.017277 14629 catalog_manager.cc:1347] Generated new cluster ID: f5f4f94b0c4f44998e28d2258d719d4f
I20260809 15:45:19.017338 14629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:19.024087 14616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:19.014445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33049 (local address 127.14.15.190:33803)
0809 15:45:19.014551 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:19.014555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:19.014789 (+ 234us) server_negotiation.cc:407] Connection header received
0809 15:45:19.014969 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:19.014972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:19.015018 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:19.015067 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:19.016002 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:19.016807 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:19.018084 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:19.018522 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:19.018602 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:19.020361 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:19.020365 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:19.020368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:19.020408 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:19.022055 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:19.022628 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:19.022632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:19.022634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:19.022723 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:19.023044 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:19.023051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:19.023052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:19.023269 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:19.023370 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:19.023767 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 15:45:19.023905 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:45:19.037842 14629 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:19.038887 14629 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:19.050168 14629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb90f9e851324681a5311e6d4966cfc0: Generated new TSK 0
I20260809 15:45:19.051111 14629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:19.063971 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14512
2026-08-09T15:45:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1657 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:19 dist-test-slave-jztv krb5kdc[14660](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:19 dist-test-slave-jztv krb5kdc[14660](info): set up 2 sockets
Aug 09 15:45:19 dist-test-slave-jztv krb5kdc[14660](info): commencing operation
krb5kdc: starting...
W20260809 15:45:20.306852 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:20 dist-test-slave-jztv krb5kdc[14660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:20.437906 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36025
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:36025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:20.552330 14681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:20.552636 14681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:20.552718 14681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:20.556824 14681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:20.556907 14681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:20.556944 14681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:20.556999 14681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:20.557047 14681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:20.562237 14681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:36025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:36025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:20.563251 14681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:20.564245 14681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:20.572598 14692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:20.572611 14689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:20.572611 14690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:20.572849 14681 server_base.cc:1034] running on GCE node
I20260809 15:45:20.573561 14681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:20.574785 14681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:20.575979 14681 hybrid_clock.cc:648] HybridClock initialized: now 1786290320575950 us; error 49 us; skew 500 ppm
Aug 09 15:45:20 dist-test-slave-jztv krb5kdc[14660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290320, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:20.578855 14681 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:20.579816 14681 webserver.cc:460] Webserver started at http://127.14.15.190:34367/ using document root <none> and password file <none>
I20260809 15:45:20.580423 14681 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:20.580519 14681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:20.580767 14681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:20.583002 14681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "8fe840a6a9a14edd878f6896d42dc11f"
format_stamp: "Formatted at 2026-08-09 15:45:20 on dist-test-slave-jztv"
server_key: "189678c63a1309a3abca24d1173a59b7"
server_key_iv: "73b6c2d29ec59996dab2482e82416bc1"
server_key_version: "encryptionkey@0"
I20260809 15:45:20.583611 14681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "8fe840a6a9a14edd878f6896d42dc11f"
format_stamp: "Formatted at 2026-08-09 15:45:20 on dist-test-slave-jztv"
server_key: "189678c63a1309a3abca24d1173a59b7"
server_key_iv: "73b6c2d29ec59996dab2482e82416bc1"
server_key_version: "encryptionkey@0"
I20260809 15:45:20.587450 14681 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 15:45:20.589913 14703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:20.591305 14681 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:45:20.591457 14681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "8fe840a6a9a14edd878f6896d42dc11f"
format_stamp: "Formatted at 2026-08-09 15:45:20 on dist-test-slave-jztv"
server_key: "189678c63a1309a3abca24d1173a59b7"
server_key_iv: "73b6c2d29ec59996dab2482e82416bc1"
server_key_version: "encryptionkey@0"
I20260809 15:45:20.591588 14681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:20.612529 14681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:20.615845 14681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:20.616076 14681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:20.623764 14681 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:36025
I20260809 15:45:20.623795 14782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:36025 every 8 connection(s)
I20260809 15:45:20.624771 14681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:20.625699 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14681
I20260809 15:45:20.625842 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:20.626184 14398 external_mini_cluster.cc:1428] Setting key 32bc52ec1039238981e00efb3d10739d
I20260809 15:45:20.628187 14783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:20.633788 14783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f: Bootstrap starting.
I20260809 15:45:20.635231 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:20.627669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51905 (local address 127.14.15.190:36025)
0809 15:45:20.628132 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:20.628147 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:20.628183 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:45:20.628867 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:20.628885 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:20.629223 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:20.629566 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:20.629973 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:20.631048 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:20.631952 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:20.632422 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:20.632596 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:20.633504 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:20.633509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:20.633520 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:20.633942 (+ 422us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:20.633999 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:20.634022 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:20.634140 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:20.634314 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 15:45:20.634524 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":148,"threads_started":1}
I20260809 15:45:20.636234 14783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:20.637145 14783 log.cc:824] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:20.638259 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:20.639273 14783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f: No bootstrap required, opened a new log
I20260809 15:45:20.643438 14783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } }
I20260809 15:45:20.643731 14783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:20.643790 14783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe840a6a9a14edd878f6896d42dc11f, State: Initialized, Role: FOLLOWER
I20260809 15:45:20.644258 14783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } }
I20260809 15:45:20.644438 14783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:20.644510 14783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:20.644634 14783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:20.645303 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:20.640314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52295 (local address 127.14.15.190:36025)
0809 15:45:20.640439 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:20.640443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:20.640619 (+ 176us) server_negotiation.cc:407] Connection header received
0809 15:45:20.640711 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:20.640714 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:20.640759 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:20.640837 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:20.641077 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:20.642830 (+ 1753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:20.643600 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:20.643945 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:20.644062 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:20.644899 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:20.644903 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:20.644906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:20.644919 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:20.644947 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:20.644963 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:20.645052 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:20.645124 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 15:45:20.645175 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:45:20.645849 14783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } }
I20260809 15:45:20.646232 14783 leader_election.cc:302] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fe840a6a9a14edd878f6896d42dc11f; no voters:
I20260809 15:45:20.646590 14783 leader_election.cc:288] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:20.646687 14793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:20.646941 14793 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [term 1 LEADER]: Becoming Leader. State: Replica: 8fe840a6a9a14edd878f6896d42dc11f, State: Running, Role: LEADER
I20260809 15:45:20.647308 14793 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } }
I20260809 15:45:20.647986 14783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:20.649226 14796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe840a6a9a14edd878f6896d42dc11f. Latest consensus state: current_term: 1 leader_uuid: "8fe840a6a9a14edd878f6896d42dc11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } } }
I20260809 15:45:20.649224 14794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fe840a6a9a14edd878f6896d42dc11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe840a6a9a14edd878f6896d42dc11f" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 36025 } } }
I20260809 15:45:20.649377 14796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:20.649377 14794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:20.649818 14811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:20.652801 14811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:20.657856 14811 catalog_manager.cc:1347] Generated new cluster ID: 677df1a8f20f47708f5238ccf74c8ee4
I20260809 15:45:20.657927 14811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:20.672515 14811 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:20.673484 14811 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:20.678557 14811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fe840a6a9a14edd878f6896d42dc11f: Generated new TSK 0
I20260809 15:45:20.679267 14811 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:20.688930 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14681
2026-08-09T15:45:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1625 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:20 dist-test-slave-jztv krb5kdc[14826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:20 dist-test-slave-jztv krb5kdc[14826](info): set up 2 sockets
Aug 09 15:45:20 dist-test-slave-jztv krb5kdc[14826](info): commencing operation
krb5kdc: starting...
W20260809 15:45:21.915897 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:22 dist-test-slave-jztv krb5kdc[14826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:22.049558 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:40509
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:40509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:22.162662 14848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:22.162978 14848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:22.163066 14848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:22.167057 14848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:22.167143 14848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:22.167189 14848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:22.167248 14848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:22.167289 14848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:22.172485 14848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:40509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:40509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:22.173569 14848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:22.174609 14848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:22.183454 14857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:22.183480 14861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:22.183454 14859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:22.183751 14848 server_base.cc:1034] running on GCE node
I20260809 15:45:22.184453 14848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:22.185650 14848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:22.186841 14848 hybrid_clock.cc:648] HybridClock initialized: now 1786290322186828 us; error 24 us; skew 500 ppm
Aug 09 15:45:22 dist-test-slave-jztv krb5kdc[14826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290322, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:22.192517 14848 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:22.193496 14848 webserver.cc:460] Webserver started at http://127.14.15.190:33209/ using document root <none> and password file <none>
I20260809 15:45:22.194079 14848 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:22.194175 14848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:22.194447 14848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:22.196518 14848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "e62566595d684208a82187d4f07a4c07"
format_stamp: "Formatted at 2026-08-09 15:45:22 on dist-test-slave-jztv"
server_key: "bba243ebf4249036c349a6cbba23760f"
server_key_iv: "6020d6f55dd515e2c35928c1770630a3"
server_key_version: "encryptionkey@0"
I20260809 15:45:22.197108 14848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "e62566595d684208a82187d4f07a4c07"
format_stamp: "Formatted at 2026-08-09 15:45:22 on dist-test-slave-jztv"
server_key: "bba243ebf4249036c349a6cbba23760f"
server_key_iv: "6020d6f55dd515e2c35928c1770630a3"
server_key_version: "encryptionkey@0"
I20260809 15:45:22.200937 14848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 15:45:22.203395 14872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:22.204620 14848 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:45:22.204766 14848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "e62566595d684208a82187d4f07a4c07"
format_stamp: "Formatted at 2026-08-09 15:45:22 on dist-test-slave-jztv"
server_key: "bba243ebf4249036c349a6cbba23760f"
server_key_iv: "6020d6f55dd515e2c35928c1770630a3"
server_key_version: "encryptionkey@0"
I20260809 15:45:22.204880 14848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:22.209496 14848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:22.212764 14848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:22.212960 14848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:22.220368 14848 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:40509
I20260809 15:45:22.220397 14954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:40509 every 8 connection(s)
I20260809 15:45:22.221312 14848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:22.224107 14955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:22.225979 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 14848
I20260809 15:45:22.226114 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:22.226476 14398 external_mini_cluster.cc:1428] Setting key 918869c1de0eba1ce9638ce190095c25
I20260809 15:45:22.230723 14955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07: Bootstrap starting.
I20260809 15:45:22.231873 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:22.227889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40163 (local address 127.14.15.190:40509)
0809 15:45:22.228337 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:22.228352 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:22.228387 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:45:22.229028 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:22.229053 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:22.229327 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:22.229663 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:22.230496 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:22.230500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:22.230511 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:22.230522 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:22.230583 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:22.230603 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:22.230755 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:22.230825 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 15:45:22.230985 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":138,"threads_started":1}
I20260809 15:45:22.233500 14955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:22.234385 14955 log.cc:824] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:22.235078 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:22.236771 14955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07: No bootstrap required, opened a new log
I20260809 15:45:22.239205 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:22.237430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33845 (local address 127.14.15.190:40509)
0809 15:45:22.237567 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:22.237572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:22.237759 (+ 187us) server_negotiation.cc:407] Connection header received
0809 15:45:22.237883 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:22.237885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:22.237914 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:22.237979 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:22.238731 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:22.238735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:22.238737 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:45:22.238747 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:22.238774 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:45:22.238784 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:22.238865 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:22.238975 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 15:45:22.239007 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:45:22.241412 14955 raft_consensus.cc:348] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } }
I20260809 15:45:22.241703 14955 raft_consensus.cc:374] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:45:22.241756 14955 raft_consensus.cc:729] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e62566595d684208a82187d4f07a4c07, State: Initialized, Role: FOLLOWER
I20260809 15:45:22.242336 14955 consensus_queue.cc:260] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } }
I20260809 15:45:22.242478 14955 raft_consensus.cc:388] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:45:22.242569 14955 raft_consensus.cc:482] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:45:22.242667 14955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:22.243640 14955 raft_consensus.cc:504] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } }
I20260809 15:45:22.243999 14955 leader_election.cc:302] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e62566595d684208a82187d4f07a4c07; no voters:
I20260809 15:45:22.244310 14955 leader_election.cc:288] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:45:22.244539 14972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:22.244828 14972 raft_consensus.cc:686] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [term 1 LEADER]: Becoming Leader. State: Replica: e62566595d684208a82187d4f07a4c07, State: Running, Role: LEADER
I20260809 15:45:22.245141 14972 consensus_queue.cc:237] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } }
I20260809 15:45:22.245648 14955 sys_catalog.cc:564] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:22.246850 14974 sys_catalog.cc:455] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e62566595d684208a82187d4f07a4c07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } } }
I20260809 15:45:22.246994 14974 sys_catalog.cc:458] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:22.247191 14976 sys_catalog.cc:455] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e62566595d684208a82187d4f07a4c07. Latest consensus state: current_term: 1 leader_uuid: "e62566595d684208a82187d4f07a4c07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62566595d684208a82187d4f07a4c07" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 40509 } } }
I20260809 15:45:22.247560 14976 sys_catalog.cc:458] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:22.247617 14987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:22.251016 14987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:22.256570 14987 catalog_manager.cc:1347] Generated new cluster ID: a961698b57804cf9a77343341f9f981a
I20260809 15:45:22.256635 14987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:22.272923 14987 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:22.273284 14987 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:22.280186 14987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e62566595d684208a82187d4f07a4c07: Generated new TSK 0
I20260809 15:45:22.281152 14987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:45:22.293164 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 14848
2026-08-09T15:45:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1605 ms)
[----------] 18 tests from AuthTokenIssuingTest (29540 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:22 dist-test-slave-jztv krb5kdc[15007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:22 dist-test-slave-jztv krb5kdc[15007](info): set up 2 sockets
Aug 09 15:45:22 dist-test-slave-jztv krb5kdc[15007](info): commencing operation
krb5kdc: starting...
W20260809 15:45:23.531165 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:23 dist-test-slave-jztv krb5kdc[15007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:23.665701 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33255
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:23.778472 15034 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:23.778841 15034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:23.778915 15034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:23.779000 15034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:23.783087 15034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:23.783195 15034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:23.783234 15034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:23.783272 15034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:23.783331 15034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:23.788712 15034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:33255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:23.789870 15034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:23.790977 15034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:23.800343 15040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:23.800351 15041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:23.800351 15045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:23.800595 15034 server_base.cc:1034] running on GCE node
I20260809 15:45:23.801234 15034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:23.802484 15034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:23.803656 15034 hybrid_clock.cc:648] HybridClock initialized: now 1786290323803644 us; error 27 us; skew 500 ppm
Aug 09 15:45:23 dist-test-slave-jztv krb5kdc[15007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:23.806802 15034 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:23.807816 15034 webserver.cc:460] Webserver started at http://127.14.15.190:35101/ using document root <none> and password file <none>
I20260809 15:45:23.808408 15034 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:23.808504 15034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:23.808746 15034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:23.810947 15034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "9796d47e39584a61adcf9af38a249285"
format_stamp: "Formatted at 2026-08-09 15:45:23 on dist-test-slave-jztv"
server_key: "23491d281aff6b85ca79c7abdef6bd9a"
server_key_iv: "99a62c048b63e6d1c4b85225a225c246"
server_key_version: "encryptionkey@0"
I20260809 15:45:23.811545 15034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "9796d47e39584a61adcf9af38a249285"
format_stamp: "Formatted at 2026-08-09 15:45:23 on dist-test-slave-jztv"
server_key: "23491d281aff6b85ca79c7abdef6bd9a"
server_key_iv: "99a62c048b63e6d1c4b85225a225c246"
server_key_version: "encryptionkey@0"
I20260809 15:45:23.815551 15034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:45:23.818145 15057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:23.819563 15034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:23.819715 15034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "9796d47e39584a61adcf9af38a249285"
format_stamp: "Formatted at 2026-08-09 15:45:23 on dist-test-slave-jztv"
server_key: "23491d281aff6b85ca79c7abdef6bd9a"
server_key_iv: "99a62c048b63e6d1c4b85225a225c246"
server_key_version: "encryptionkey@0"
I20260809 15:45:23.819842 15034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:23.836702 15034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:23.840405 15034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:23.840629 15034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:23.848745 15034 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:33255
I20260809 15:45:23.849052 15136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:33255 every 8 connection(s)
I20260809 15:45:23.849771 15034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:23.852702 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15034
I20260809 15:45:23.852778 15138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:23.852849 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:23.853188 14398 external_mini_cluster.cc:1428] Setting key 0963370230d541afe053ed81f4dc97b0
I20260809 15:45:23.857306 15138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.15.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.189@KRBTEST.COM" created.
Aug 09 15:45:23 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:23.875121 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.860054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33255 (local address 127.0.0.1:59174)
0809 15:45:23.861437 (+ 1383us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.861500 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:23.863608 (+ 2108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:23.864387 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:23.864393 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:23.864838 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:23.865098 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:23.865113 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:23.866544 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:23.866547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:23.867266 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:23.867276 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:23.867933 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:23.867937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:23.868045 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:23.868698 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:23.868714 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:23.870117 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:23.872120 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:23.872131 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:23.872140 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:23.872364 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:23.872704 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:23.872707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:23.872709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:23.872822 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:23.873418 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:23.873423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:23.873560 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 15:45:23.873732 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 15:45:23.874124 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"mutex_wait_us":111,"thread_start_us":250,"threads_started":1}
I20260809 15:45:23.875150 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.860046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59174 (local address 127.14.15.190:33255)
0809 15:45:23.861030 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:23.861051 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:23.861618 (+ 567us) server_negotiation.cc:407] Connection header received
0809 15:45:23.863934 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:23.863939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:23.864184 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:23.864390 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:23.865256 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:23.866411 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:23.867405 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:23.867773 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:23.867947 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:23.870290 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:23.870296 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:23.870306 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:23.870328 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:23.872006 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:23.872477 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:23.872494 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:23.872496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:23.872598 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:23.872918 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:23.872924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:23.872925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:23.873293 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:23.873435 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:23.873795 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 15:45:23.874044 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":143,"threads_started":1}
I20260809 15:45:23.877625 15138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:23.878448 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.878130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:44998)
0809 15:45:23.878299 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.878385 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:45:23.878647 15059 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
I20260809 15:45:23.879427 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.879190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45012)
0809 15:45:23.879302 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.879351 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 15:45:23.879617 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:40145: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
I20260809 15:45:23.882856 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:40145
--webserver_interface=127.14.15.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:45:23.928872 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } attempt: 1
I20260809 15:45:23.929803 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.929458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45026)
0809 15:45:23.929632 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.929707 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 15:45:23.930614 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.930377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45030)
0809 15:45:23.930491 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.930545 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:45:23.930768 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:40145: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
I20260809 15:45:23.998986 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } attempt: 2
W20260809 15:45:23.999505 15148 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:23.999850 15148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:23.999900 15148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260809 15:45:23.999930 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:23.999576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45036)
0809 15:45:23.999751 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:23.999828 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 15:45:23.999963 15148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:45:24.000665 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.000433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45044)
0809 15:45:24.000544 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.000596 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 15:45:24.000813 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:40145: Network error: Client connection negotiation failed: client connection to 127.14.15.189:40145: connect: Connection refused (error 111)
W20260809 15:45:24.004346 15148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:24.004402 15148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:24.004422 15148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:24.004477 15148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:24.004532 15148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:24.010000 15148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:40145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.15.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:24.011165 15148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:24.012231 15148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:24.020977 15164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:24.020977 15159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:24.020984 15156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:24.021334 15148 server_base.cc:1034] running on GCE node
I20260809 15:45:24.021998 15148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:24.023386 15148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:24.024556 15148 hybrid_clock.cc:648] HybridClock initialized: now 1786290324024541 us; error 27 us; skew 500 ppm
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:24.027683 15148 init.cc:377] Logged in from keytab as kudu/127.14.15.189@KRBTEST.COM (short username kudu)
I20260809 15:45:24.028592 15148 webserver.cc:460] Webserver started at http://127.14.15.189:44101/ using document root <none> and password file <none>
I20260809 15:45:24.029177 15148 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:24.029270 15148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:24.029516 15148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:24.031659 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data/instance:
uuid: "1969da59e74b42099472deff3a69afe8"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "cd1933a2ec65daea598383414353a98d"
server_key_iv: "be653aabec7b86043e26923114a42ead"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.032255 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal/instance:
uuid: "1969da59e74b42099472deff3a69afe8"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "cd1933a2ec65daea598383414353a98d"
server_key_iv: "be653aabec7b86043e26923114a42ead"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.036088 15148 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:45:24.038584 15176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:24.039804 15148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:45:24.039952 15148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "1969da59e74b42099472deff3a69afe8"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "cd1933a2ec65daea598383414353a98d"
server_key_iv: "be653aabec7b86043e26923114a42ead"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.040068 15148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:24.051275 15148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:24.054569 15148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:24.054768 15148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:24.062042 15148 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.189:40145
I20260809 15:45:24.062355 15261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.189:40145 every 8 connection(s)
I20260809 15:45:24.063107 15148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
I20260809 15:45:24.065766 15262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:24.069375 15262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.070093 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15148
I20260809 15:45:24.070225 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-1/wal/instance
I20260809 15:45:24.070515 14398 external_mini_cluster.cc:1428] Setting key e7331988c64ff0c073a9a96b697983a7
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.15.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.188@KRBTEST.COM" created.
I20260809 15:45:24.084152 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.071383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.14.15.190:33255)
0809 15:45:24.071551 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.071556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.072390 (+ 834us) server_negotiation.cc:407] Connection header received
0809 15:45:24.073334 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.073337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.073398 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.073506 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.074742 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.075335 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.076475 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.076727 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.076845 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.079651 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.079654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.079657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.079683 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.081717 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.082320 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.082324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.082326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.082414 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.082805 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.082811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.082816 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.083103 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.083214 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.083732 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.083891 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:45:24.084962 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.071751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33255 (local address 127.0.0.1:59178)
0809 15:45:24.072214 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.072265 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.073114 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.073682 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.073688 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.074026 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.074582 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.074598 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.075491 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.075494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.076343 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.076353 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.076886 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.076891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.077065 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.077713 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.077728 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.079450 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.081843 (+ 2393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.081849 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.081865 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.082207 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.082535 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.082539 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.082541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.082682 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.083209 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.083215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.083456 (+ 241us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.083615 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.083873 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":136,"threads_started":1}
I20260809 15:45:24.086467 15262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.091969 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } attempt: 3
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:45:24.098767 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.087039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45056)
0809 15:45:24.087242 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.087260 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.087344 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.087847 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.087851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.088048 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.088208 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.088219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.089197 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.089204 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.090142 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.090156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.090817 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.090824 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.090969 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.091450 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.091469 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.094429 (+ 2960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.096875 (+ 2446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.096882 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.096886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.097109 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.097476 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.097480 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.097483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.097583 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.098099 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.098101 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.098200 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.098389 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.098577 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 15:45:24.098903 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.087135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45056 (local address 127.14.15.189:40145)
0809 15:45:24.087502 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.087512 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.087530 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:45:24.087566 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.087570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.087708 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.087811 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.088343 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.089077 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.090308 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.090686 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.090772 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.094579 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.094590 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.094605 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.094630 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.096717 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.097238 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.097245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.097247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.097338 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.097702 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.097707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.097708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.097979 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.098139 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.098502 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.098645 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":165,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
I20260809 15:45:24.101930 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.092465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45070)
0809 15:45:24.092598 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.092614 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.092720 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.093094 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.093098 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.093266 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.093352 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.093357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.094143 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.094148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.094969 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.094992 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.095790 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.095795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.095931 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.096344 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.096360 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.097732 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.100314 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.100317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.100319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.100557 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.100904 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.100907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.100909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.100998 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.101378 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.101382 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.101494 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.101612 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.101760 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:45:24.101945 15270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.092538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.14.15.189:40145)
0809 15:45:24.092847 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.092874 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.092885 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:45:24.092911 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.092913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.092975 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.093075 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.093514 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.094030 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.095110 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.095397 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.095542 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.097855 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.097858 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.097861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.097888 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.100191 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.100670 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.100675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.100676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.100763 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.101099 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.101103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.101105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.101275 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.101386 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.101677 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.101786 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":87,"threads_started":1}
I20260809 15:45:24.101891 15262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.102285 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:33347
--webserver_interface=127.14.15.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:36471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:45:24.102836 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.102408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47756)
0809 15:45:24.102659 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.102750 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
W20260809 15:45:24.103047 15177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
I20260809 15:45:24.103219 15138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.103948 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.103668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47768)
0809 15:45:24.103832 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.103888 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 15:45:24.103981 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.103695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47774)
0809 15:45:24.103827 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.103899 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 15:45:24.104123 15262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
I20260809 15:45:24.104740 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.104468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47778)
0809 15:45:24.104638 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.104684 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260809 15:45:24.104898 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
I20260809 15:45:24.136077 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 1
I20260809 15:45:24.137044 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.136730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47788)
0809 15:45:24.136894 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.136965 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 15:45:24.137894 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.137597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47790)
0809 15:45:24.137715 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.137787 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:45:24.138057 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
I20260809 15:45:24.153414 15262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 1
I20260809 15:45:24.154273 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.153936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47792)
0809 15:45:24.154094 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.154162 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 15:45:24.155107 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.154873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47806)
0809 15:45:24.154987 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.155042 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:45:24.155278 15262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
I20260809 15:45:24.213235 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 2
I20260809 15:45:24.214150 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.213825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47814)
0809 15:45:24.214000 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.214071 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 15:45:24.214977 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.214741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47816)
0809 15:45:24.214858 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.214920 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:45:24.215176 15138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
W20260809 15:45:24.220678 15272 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:24.220957 15272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:24.221009 15272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:24.221117 15272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:45:24.223413 15262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 2
I20260809 15:45:24.224165 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.223867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47822)
0809 15:45:24.224023 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.224084 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 15:45:24.224936 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.224728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47830)
0809 15:45:24.224828 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.224880 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 15:45:24.225082 15262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:33347: Network error: Client connection negotiation failed: client connection to 127.14.15.188:33347: connect: Connection refused (error 111)
W20260809 15:45:24.226011 15272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:24.226059 15272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:24.226104 15272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:24.226137 15272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:24.226171 15272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:24.231602 15272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:36471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:33255,127.14.15.189:40145,127.14.15.188:33347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:33347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.15.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:24.232640 15272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:24.233659 15272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:24.242092 15281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:24.242094 15278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:24.242189 15272 server_base.cc:1034] running on GCE node
W20260809 15:45:24.242095 15277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:24.242983 15272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:24.244213 15272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:24.245407 15272 hybrid_clock.cc:648] HybridClock initialized: now 1786290324245397 us; error 31 us; skew 500 ppm
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:24.248215 15272 init.cc:377] Logged in from keytab as kudu/127.14.15.188@KRBTEST.COM (short username kudu)
I20260809 15:45:24.249105 15272 webserver.cc:460] Webserver started at http://127.14.15.188:38285/ using document root <none> and password file <none>
I20260809 15:45:24.249692 15272 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:24.249784 15272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:24.250025 15272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:24.252125 15272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data/instance:
uuid: "e52bea7b09ee4498854d87f2da2f6aa9"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "6f76ac701bd72c129ec4767d30d91823"
server_key_iv: "d406726b340bbad0691bfc522eab28bf"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.252707 15272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal/instance:
uuid: "e52bea7b09ee4498854d87f2da2f6aa9"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "6f76ac701bd72c129ec4767d30d91823"
server_key_iv: "d406726b340bbad0691bfc522eab28bf"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.256314 15272 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 15:45:24.258704 15295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:24.259858 15272 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:45:24.260002 15272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "e52bea7b09ee4498854d87f2da2f6aa9"
format_stamp: "Formatted at 2026-08-09 15:45:24 on dist-test-slave-jztv"
server_key: "6f76ac701bd72c129ec4767d30d91823"
server_key_iv: "d406726b340bbad0691bfc522eab28bf"
server_key_version: "encryptionkey@0"
I20260809 15:45:24.260118 15272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:24.278170 15272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:24.282718 15272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:24.283025 15272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:24.290727 15272 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.188:33347
I20260809 15:45:24.291028 15367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.188:33347 every 8 connection(s)
I20260809 15:45:24.291816 15272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
I20260809 15:45:24.294943 15368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:24.298995 15368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.300551 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15272
I20260809 15:45:24.300707 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786290023600843-14398-0/minicluster-data/master-2/wal/instance
I20260809 15:45:24.301010 14398 external_mini_cluster.cc:1428] Setting key 455c865a31fd0638b4ee5c571af33209
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
I20260809 15:45:24.313972 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.301198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.14.15.190:33255)
0809 15:45:24.301388 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.301395 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.302812 (+ 1417us) server_negotiation.cc:407] Connection header received
0809 15:45:24.303939 (+ 1127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.303943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.304007 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.304089 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.304966 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.305504 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.306684 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.306935 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.307065 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.309810 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.309813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.309815 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.309844 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.311642 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.312220 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.312222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.312224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.312314 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.312727 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.312731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.312733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.312971 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.313090 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.313655 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.313790 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 15:45:24.314333 15138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 3
I20260809 15:45:24.315294 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.301894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:33255 (local address 127.0.0.1:59192)
0809 15:45:24.302633 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.302690 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.303712 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.304142 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.304147 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.304518 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.304806 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.304819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.305628 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.305633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.306547 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.306558 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.307106 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.307110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.307279 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.307948 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.307981 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.309628 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.311766 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.311779 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.311790 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.312119 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.312412 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.312415 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.312418 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.312620 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.313089 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.313098 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.313416 (+ 318us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.313606 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.313935 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":22,"spinlock_wait_cycles":1408,"thread_start_us":160,"threads_started":1}
I20260809 15:45:24.315292 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.303044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47838 (local address 127.14.15.188:33347)
0809 15:45:24.303340 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.303349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.303385 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:45:24.303722 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.303744 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.303940 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.304149 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.305020 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.305901 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.306874 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.307254 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.307379 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.310315 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.310320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.310332 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.310354 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.312043 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.312560 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.312565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.312566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.312642 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.312978 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.312983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.312985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.313427 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.313666 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.313884 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.314038 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":203,"thread_start_us":112,"threads_started":1}
I20260809 15:45:24.316247 15262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } attempt: 3
I20260809 15:45:24.318503 15368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:45:24.327705 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.314781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47846)
0809 15:45:24.314976 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.314990 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.315066 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.315520 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.315523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.315710 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.315818 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.315825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.316933 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.316936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.317597 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.317612 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.318388 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.318394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.318496 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.319046 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.319061 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.320779 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.325673 (+ 4894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.325677 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.325679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.325935 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.326331 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.326338 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.326341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.326454 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.327007 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.327010 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.327127 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.327251 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.327499 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126}
I20260809 15:45:24.327749 15373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.314854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.14.15.188:33347)
0809 15:45:24.315233 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.315241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.315255 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:45:24.315293 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.315296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.315350 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.315960 (+ 610us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.316049 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.316823 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.317879 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.318248 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.320822 (+ 2574us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.320932 (+ 110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.320935 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.320938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.320955 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.325558 (+ 4603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.326069 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.326071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.326073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.326161 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.326585 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.326590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.326595 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.326854 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.326997 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.327331 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.327504 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":184,"threads_started":1}
I20260809 15:45:24.328269 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.316846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47860)
0809 15:45:24.317045 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.317059 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.317140 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.317537 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.317541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.317745 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.317870 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.317878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.319442 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.319446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.320239 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.320253 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.320893 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.320897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.320986 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.321490 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.321511 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.323084 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.325481 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.325486 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.325488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.325746 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.326085 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.326089 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.326091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.326186 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.327691 (+ 1505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.327694 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.327812 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.327901 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.328102 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 15:45:24.328939 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.316773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47860 (local address 127.14.15.188:33347)
0809 15:45:24.317282 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.317286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.317298 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:45:24.317331 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.317333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.317376 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.317991 (+ 615us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.318091 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.319312 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.320393 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.320746 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.321212 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.323298 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.323302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.323307 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.323333 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.325343 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.325892 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.325896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.325899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.326000 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.326984 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.326988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.326990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.327197 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.328558 (+ 1361us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.328667 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.328802 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":438}
I20260809 15:45:24.329643 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.318530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.14.15.190:33255)
0809 15:45:24.318664 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.318668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.318776 (+ 108us) server_negotiation.cc:407] Connection header received
0809 15:45:24.318931 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.318936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.318996 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.319052 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.320029 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.320733 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.321899 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.322316 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.322460 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.325574 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.325579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.325583 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.325615 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.327544 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.328069 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.328076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.328079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.328166 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.328504 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.328508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.328509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.328756 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.328956 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.329342 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.329471 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:45:24.331810 15138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: Bootstrap starting.
I20260809 15:45:24.331851 15262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: Bootstrap starting.
I20260809 15:45:24.335023 15138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: Neither blocks nor log segments found. Creating new log.
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:45:24.336216 15138 log.cc:824] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:24.336536 15262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:24.337533 15262 log.cc:824] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:24.338730 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.319253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.14.15.189:40145)
0809 15:45:24.319834 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.319838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.320015 (+ 177us) server_negotiation.cc:407] Connection header received
0809 15:45:24.320180 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.320183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.320235 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.320285 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.321288 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.321984 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.323195 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.324041 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.324164 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.334306 (+ 10142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.334310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.334313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.334340 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.336146 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.337028 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.337032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.337034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.337131 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.337548 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.337554 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.337558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.337867 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.337951 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.338397 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.338547 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491}
I20260809 15:45:24.339062 15138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: No bootstrap required, opened a new log
I20260809 15:45:24.339637 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.319019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:40145 (local address 127.0.0.1:45082)
0809 15:45:24.319940 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.319955 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.320080 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.320411 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.320414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.320586 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.320682 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.320688 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.322097 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.322099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.323076 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.323091 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.324783 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.324787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.324901 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.325360 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.325379 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.327560 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.336298 (+ 8738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.336306 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.336311 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.336636 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.337273 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.337279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.337282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.337420 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.338041 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.338044 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.338168 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.339210 (+ 1042us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.339449 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838}
I20260809 15:45:24.339820 15262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: No bootstrap required, opened a new log
I20260809 15:45:24.340780 15270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.330913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.14.15.189:40145)
0809 15:45:24.331029 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.331034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.331116 (+ 82us) server_negotiation.cc:407] Connection header received
0809 15:45:24.331233 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.331235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.331278 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.331377 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.331992 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.332531 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.333311 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.333584 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.333702 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.336452 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.336455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.336458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.336483 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.338269 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.338772 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.338776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.338778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.338857 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.339196 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.339199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.339201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.339432 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.340432 (+ 1000us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.340508 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.340638 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:45:24.340799 15368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:24.344580 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:24.344403 15262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.344452 15138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.344664 15138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9796d47e39584a61adcf9af38a249285, State: Initialized, Role: FOLLOWER
I20260809 15:45:24.344664 15262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1969da59e74b42099472deff3a69afe8, State: Initialized, Role: FOLLOWER
I20260809 15:45:24.345036 15138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.345036 15262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.346640 15138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:24.346640 15262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:24.346678 15378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.346837 15378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 15:45:24 dist-test-slave-jztv krb5kdc[15007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290324, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
I20260809 15:45:24.347148 15379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.347294 15379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.347401 15099 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9796d47e39584a61adcf9af38a249285"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59194
I20260809 15:45:24.347714 15099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 15:45:24.347837 15099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:24.349344 15099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.350412 15099 leader_election.cc:288] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [CANDIDATE]: Term 1 election: Requested vote from peers 1969da59e74b42099472deff3a69afe8 (127.14.15.189:40145), e52bea7b09ee4498854d87f2da2f6aa9 (127.14.15.188:33347)
I20260809 15:45:24.351722 15216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9796d47e39584a61adcf9af38a249285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1969da59e74b42099472deff3a69afe8"
I20260809 15:45:24.352003 15216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [term 0 FOLLOWER]: Advancing to term 1
W20260809 15:45:24.352903 15413 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:24.352963 15413 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:24.353523 15216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9796d47e39584a61adcf9af38a249285 in term 1.
I20260809 15:45:24.355055 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.341561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:33347 (local address 127.0.0.1:47872)
0809 15:45:24.341698 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:24.341713 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:24.341793 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:24.342056 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:24.342059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:24.342290 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:24.342394 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.342413 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.343325 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.343328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.344172 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:24.344183 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.345003 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.345006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:24.345109 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.345689 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:24.345707 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:24.350967 (+ 5260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:24.353223 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.353226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.353228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.353497 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.353838 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:24.353841 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:24.353844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:24.353944 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:24.354514 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:24.354516 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:24.354602 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 15:45:24.354702 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 15:45:24.354863 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 15:45:24.355517 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.341719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47872 (local address 127.14.15.188:33347)
0809 15:45:24.341820 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.341824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.341839 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:45:24.341886 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.341889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.341936 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.342023 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.342525 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.343207 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.344295 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.344726 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.344831 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.351117 (+ 6286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.351123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.351126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.351155 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.353076 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.353627 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.353630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.353632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.353724 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.354062 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.354067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.354070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.354384 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.354482 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.355257 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.355379 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 15:45:24.353974 15148 master_runner.cc:186] Error getting master registration for 127.14.15.190:33255: OK, instance_id { permanent_uuid: "9796d47e39584a61adcf9af38a249285" instance_seqno: 1786290323846550 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:45:24.357463 15148 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:45:24.358531 15368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: Bootstrap starting.
I20260809 15:45:24.361418 15059 leader_election.cc:302] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1969da59e74b42099472deff3a69afe8, 9796d47e39584a61adcf9af38a249285; no voters:
I20260809 15:45:24.361778 15379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:24.362046 15379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [term 1 LEADER]: Becoming Leader. State: Replica: 9796d47e39584a61adcf9af38a249285, State: Running, Role: LEADER
I20260809 15:45:24.362447 15379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.364607 15419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9796d47e39584a61adcf9af38a249285. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.364733 15419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:24.365944 15368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:24.367055 15368 log.cc:824] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: Log is configured to *not* fsync() on all Append() calls
W20260809 15:45:24.368316 15414 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:24.368409 15414 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:24.370409 15368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: No bootstrap required, opened a new log
I20260809 15:45:24.368458 15034 master_runner.cc:186] Error getting master registration for 127.14.15.188:33347: OK, instance_id { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" instance_seqno: 1786290324288701 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:45:24.372510 15034 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:45:24.375077 15368 raft_consensus.cc:348] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.375378 15368 raft_consensus.cc:729] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e52bea7b09ee4498854d87f2da2f6aa9, State: Initialized, Role: FOLLOWER
I20260809 15:45:24.375728 15368 consensus_queue.cc:260] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } }
I20260809 15:45:24.377241 15368 sys_catalog.cc:564] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:24.377316 15330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9796d47e39584a61adcf9af38a249285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e52bea7b09ee4498854d87f2da2f6aa9"
I20260809 15:45:24.377580 15330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:24.379562 15330 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9796d47e39584a61adcf9af38a249285 in term 1.
I20260809 15:45:24.380420 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.363229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.14.15.190:33255)
0809 15:45:24.363361 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.363367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.364664 (+ 1297us) server_negotiation.cc:407] Connection header received
0809 15:45:24.365079 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.365083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.365133 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.365185 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.366910 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.367693 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.369605 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.369960 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.370052 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.373093 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.373097 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.373100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.373129 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.375102 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.375913 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.375918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.375920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.376039 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.376521 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.376527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.376529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.376760 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.376889 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.380086 (+ 3197us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.380249 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:45:24.386622 15426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:24.387878 15426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:24.389714 15270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.364666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45094 (local address 127.14.15.189:40145)
0809 15:45:24.364959 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.364963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.381122 (+ 16159us) server_negotiation.cc:407] Connection header received
0809 15:45:24.381336 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.381340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.381398 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.381500 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.382344 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.383120 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.384169 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.384512 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.384582 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.386197 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.386201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.386204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.386250 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.387913 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.388399 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.388402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.388404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.388487 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.388779 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.388783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.388784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.388995 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.389093 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.389440 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.389559 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260809 15:45:24.390363 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:24.363185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47876 (local address 127.14.15.188:33347)
0809 15:45:24.363299 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.363304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.373836 (+ 10532us) server_negotiation.cc:407] Connection header received
0809 15:45:24.374020 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.374024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.374082 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.374134 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.375065 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.375803 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.377041 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:24.377350 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:24.377430 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:24.385937 (+ 8507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:24.385941 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:24.385944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:24.385972 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:24.388288 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.388735 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.388739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.388741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.388832 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:24.389158 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:24.389161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:24.389163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:24.389377 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:24.389484 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:24.390075 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 15:45:24.390192 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:45:24.396154 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.396303 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.397897 15330 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [term 1 FOLLOWER]: Refusing update from remote peer 9796d47e39584a61adcf9af38a249285: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:45:24.398509 15216 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [term 1 FOLLOWER]: Refusing update from remote peer 9796d47e39584a61adcf9af38a249285: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:45:24.398583 15419 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:45:24.399119 15419 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:45:24.402072 15449 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:24.402155 15449 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:24.402776 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9796d47e39584a61adcf9af38a249285. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.402891 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.403119 15378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9796d47e39584a61adcf9af38a249285. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.403244 15378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.410564 15419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.410698 15419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:24.410825 15450 mvcc.cc:205] Tried to move back new op lower bound from 7316645168726433792 to 7316645168592666624. Current Snapshot: MvccSnapshot[applied={T|T < 7316645168726433792}]
I20260809 15:45:24.410868 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.411013 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.411242 15452 mvcc.cc:205] Tried to move back new op lower bound from 7316645168726433792 to 7316645168592666624. Current Snapshot: MvccSnapshot[applied={T|T < 7316645168726433792}]
I20260809 15:45:24.412298 15379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.412416 15379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:24.413260 15378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9796d47e39584a61adcf9af38a249285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9796d47e39584a61adcf9af38a249285" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 33255 } } peers { permanent_uuid: "1969da59e74b42099472deff3a69afe8" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 40145 } } peers { permanent_uuid: "e52bea7b09ee4498854d87f2da2f6aa9" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 33347 } } }
I20260809 15:45:24.413395 15378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:24.420882 15426 catalog_manager.cc:1347] Generated new cluster ID: 52bad1972f824f129ef3574a37b95418
I20260809 15:45:24.420992 15426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:45:24.434134 15426 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:24.435667 15426 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:24.470664 15426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9796d47e39584a61adcf9af38a249285: Generated new TSK 0
I20260809 15:45:24.471637 15426 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:45:24.511330 15141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.508678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.14.15.190:33255)
0809 15:45:24.508815 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.508819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.510130 (+ 1311us) server_negotiation.cc:407] Connection header received
0809 15:45:24.510390 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.510395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.510448 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.510514 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.511182 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59218: BlockingRecv error: recv got EOF from 127.0.0.1:59218 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 15:45:24.512715 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.509522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.14.15.189:40145)
0809 15:45:24.509635 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.509640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.511826 (+ 2186us) server_negotiation.cc:407] Connection header received
0809 15:45:24.512007 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.512010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.512059 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.512109 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.512601 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45096: BlockingRecv error: recv got EOF from 127.0.0.1:45096 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 15:45:24.514519 15372 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.513208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47888 (local address 127.14.15.188:33347)
0809 15:45:24.513361 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.513366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.513700 (+ 334us) server_negotiation.cc:407] Connection header received
0809 15:45:24.513812 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.513815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.513871 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.513975 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.514394 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47888: BlockingRecv error: recv got EOF from 127.0.0.1:47888 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 15:45:24.518463 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.516910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45102 (local address 127.14.15.189:40145)
0809 15:45:24.517009 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.517013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.517504 (+ 491us) server_negotiation.cc:407] Connection header received
0809 15:45:24.517718 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.517721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.517796 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.517847 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.518364 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45102: BlockingRecv error: recv got EOF from 127.0.0.1:45102 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 15:45:24.523463 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.521904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45118 (local address 127.14.15.189:40145)
0809 15:45:24.521998 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.522002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.522598 (+ 596us) server_negotiation.cc:407] Connection header received
0809 15:45:24.522774 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.522777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.522831 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.522879 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.523363 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45118: BlockingRecv error: recv got EOF from 127.0.0.1:45118 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 15:45:24.529093 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.527622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45126 (local address 127.14.15.189:40145)
0809 15:45:24.527714 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.527718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.528184 (+ 466us) server_negotiation.cc:407] Connection header received
0809 15:45:24.528360 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.528363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.528412 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.528464 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.528991 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45126: BlockingRecv error: recv got EOF from 127.0.0.1:45126 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 15:45:24.537352 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.535566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45142 (local address 127.14.15.189:40145)
0809 15:45:24.535711 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.535716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.536296 (+ 580us) server_negotiation.cc:407] Connection header received
0809 15:45:24.536532 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.536536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.536594 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.536652 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.537235 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45142: BlockingRecv error: recv got EOF from 127.0.0.1:45142 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260809 15:45:24.550199 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.548260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.14.15.189:40145)
0809 15:45:24.548396 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.548403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.549098 (+ 695us) server_negotiation.cc:407] Connection header received
0809 15:45:24.549341 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.549346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.549405 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.549460 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.550076 (+ 616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45152: BlockingRecv error: recv got EOF from 127.0.0.1:45152 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 15:45:24.571178 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.569214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.14.15.189:40145)
0809 15:45:24.569356 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.569361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.570019 (+ 658us) server_negotiation.cc:407] Connection header received
0809 15:45:24.570314 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.570319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.570382 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.570439 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.571055 (+ 616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45164: BlockingRecv error: recv got EOF from 127.0.0.1:45164 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 15:45:24.607342 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.606019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.14.15.189:40145)
0809 15:45:24.606185 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.606191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.606422 (+ 231us) server_negotiation.cc:407] Connection header received
0809 15:45:24.606563 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.606566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.606626 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.606702 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.607203 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45178: BlockingRecv error: recv got EOF from 127.0.0.1:45178 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 15:45:24.675074 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.673684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.14.15.189:40145)
0809 15:45:24.673895 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.673900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.674036 (+ 136us) server_negotiation.cc:407] Connection header received
0809 15:45:24.674259 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.674263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.674323 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.674448 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.674973 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45190: BlockingRecv error: recv got EOF from 127.0.0.1:45190 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 15:45:24.806658 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:24.805378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45204 (local address 127.14.15.189:40145)
0809 15:45:24.805553 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:24.805564 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:24.805698 (+ 134us) server_negotiation.cc:407] Connection header received
0809 15:45:24.805883 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:24.805891 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:24.805942 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:24.806040 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:24.806546 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45204: BlockingRecv error: recv got EOF from 127.0.0.1:45204 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 15:45:25.066356 15270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:25.065104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45208 (local address 127.14.15.189:40145)
0809 15:45:25.065266 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.065271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.065436 (+ 165us) server_negotiation.cc:407] Connection header received
0809 15:45:25.065580 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.065583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.065633 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.065706 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:25.066219 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45208: BlockingRecv error: recv got EOF from 127.0.0.1:45208 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:45:25.354328 15413 catalog_manager.cc:1259] Loaded cluster ID: 52bad1972f824f129ef3574a37b95418
I20260809 15:45:25.354417 15413 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: loading cluster ID for follower catalog manager: success
I20260809 15:45:25.356065 15413 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: acquiring CA information for follower catalog manager: success
I20260809 15:45:25.357215 15413 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1969da59e74b42099472deff3a69afe8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:45:25.403642 15449 catalog_manager.cc:1259] Loaded cluster ID: 52bad1972f824f129ef3574a37b95418
I20260809 15:45:25.403735 15449 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: loading cluster ID for follower catalog manager: success
I20260809 15:45:25.405414 15449 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: acquiring CA information for follower catalog manager: success
I20260809 15:45:25.406663 15449 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e52bea7b09ee4498854d87f2da2f6aa9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:45:25.584206 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:25.580659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37602 (local address 127.14.15.189:40145)
0809 15:45:25.580893 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.580896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.580912 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:45:25.581005 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.581008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.581136 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.581245 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:25.581503 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.582032 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.582863 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.583091 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.583172 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:25.583446 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:25.583883 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:25.583973 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:25.584031 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 15:45:25.584081 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":86,"threads_started":1}
I20260809 15:45:25.591389 15561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:25.587697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.14.15.188:33347)
0809 15:45:25.587980 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.587986 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.588002 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:45:25.588089 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.588091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.588206 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.588330 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:25.588566 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.589082 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.589913 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.590143 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.590273 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:25.590599 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:25.590969 (+ 370us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:25.591108 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:25.591174 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 15:45:25.591229 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":79,"threads_started":1}
I20260809 15:45:25.598664 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:25.594636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37606 (local address 127.14.15.189:40145)
0809 15:45:25.594770 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.594775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.595067 (+ 292us) server_negotiation.cc:407] Connection header received
0809 15:45:25.595295 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.595299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.595348 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.595428 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:25.595700 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.596260 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.597381 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.597767 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.597877 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:25.598126 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:25.598240 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:25.598322 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:25.598447 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 15:45:25.598502 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:45:25.598986 15561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:25.594735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54244 (local address 127.14.15.188:33347)
0809 15:45:25.594842 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.594846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.595052 (+ 206us) server_negotiation.cc:407] Connection header received
0809 15:45:25.595209 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.595215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.595284 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.595323 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:25.595834 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.596622 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.597799 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.598105 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.598203 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:25.598498 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:25.598601 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:25.598650 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:25.598816 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 15:45:25.598868 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:45:25.599555 15570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:25.594403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.14.15.190:33255)
0809 15:45:25.594844 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:25.594851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:25.595090 (+ 239us) server_negotiation.cc:407] Connection header received
0809 15:45:25.595249 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:25.595255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:25.595427 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:25.595537 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:25.595892 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.596689 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.597728 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:25.598130 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:25.598278 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:25.598687 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:25.599038 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:25.599145 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:25.599300 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 15:45:25.599379 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":90,"threads_started":1}
I20260809 15:45:25.602650 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15034
I20260809 15:45:25.614975 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15148
I20260809 15:45:25.629132 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15272
2026-08-09T15:45:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3333 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:45:25 dist-test-slave-jztv krb5kdc[15577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:45:25 dist-test-slave-jztv krb5kdc[15577](info): set up 2 sockets
Aug 09 15:45:25 dist-test-slave-jztv krb5kdc[15577](info): commencing operation
krb5kdc: starting...
W20260809 15:45:26.873127 14398 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/test-user.keytab.
Aug 09 15:45:26 dist-test-slave-jztv krb5kdc[15577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:45:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:45:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.15.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
Entry for principal kudu/127.14.15.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab.
I20260809 15:45:27.000499 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41151
--webserver_interface=127.14.15.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:45:27.113251 15592 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:27.113631 15592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:27.113706 15592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:27.113796 15592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:27.117942 15592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:27.118044 15592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:27.118083 15592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:27.118122 15592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:27.118158 15592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:27.123641 15592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.190.keytab
--principal=kudu/127.14.15.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.190:41151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.15.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:27.124794 15592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:27.125847 15592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:27.134624 15599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:27.134667 15592 server_base.cc:1034] running on GCE node
W20260809 15:45:27.134611 15601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:27.134611 15598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:27.135604 15592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:27.136709 15592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:27.137892 15592 hybrid_clock.cc:648] HybridClock initialized: now 1786290327137863 us; error 41 us; skew 500 ppm
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:27.140679 15592 init.cc:377] Logged in from keytab as kudu/127.14.15.190@KRBTEST.COM (short username kudu)
I20260809 15:45:27.141536 15592 webserver.cc:460] Webserver started at http://127.14.15.190:39723/ using document root <none> and password file <none>
I20260809 15:45:27.142066 15592 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:27.142124 15592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:27.142359 15592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:27.144361 15592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data/instance:
uuid: "af4824282f394e458558bf6e63218354"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "edb03e439905553c5bc2fba58e9d9086"
server_key_iv: "61b0cefab8f44f9af23fe04d6928ce2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.144901 15592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance:
uuid: "af4824282f394e458558bf6e63218354"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "edb03e439905553c5bc2fba58e9d9086"
server_key_iv: "61b0cefab8f44f9af23fe04d6928ce2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.148548 15592 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:45:27.150910 15609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:27.152127 15592 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:45:27.152274 15592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal
uuid: "af4824282f394e458558bf6e63218354"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "edb03e439905553c5bc2fba58e9d9086"
server_key_iv: "61b0cefab8f44f9af23fe04d6928ce2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.152392 15592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:27.184288 15592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:27.187203 15592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:27.187420 15592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:27.194589 15592 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.190:41151
I20260809 15:45:27.194880 15698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.190:41151 every 8 connection(s)
I20260809 15:45:27.195683 15592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/data/info.pb
I20260809 15:45:27.197489 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15592
I20260809 15:45:27.197623 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-0/wal/instance
I20260809 15:45:27.197949 14398 external_mini_cluster.cc:1428] Setting key c79a1469b32f7f1671e8d18fa4b7baac
I20260809 15:45:27.198863 15699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:27.203058 15699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.15.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.189@KRBTEST.COM" created.
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:27.222497 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.205285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41151 (local address 127.0.0.1:37616)
0809 15:45:27.205764 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.205815 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.206714 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.207387 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.207392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.207828 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.208101 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.208116 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.209355 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.209363 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.210297 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.210312 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.210999 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.211006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.211176 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.215634 (+ 4458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.215652 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.217423 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.219539 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.219548 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.219556 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.219785 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.220083 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.220085 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.220087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.220205 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.220956 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.220961 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.221089 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.221245 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.221710 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":128,"thread_start_us":146,"threads_started":1}
I20260809 15:45:27.222510 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.205285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37616 (local address 127.14.15.190:41151)
0809 15:45:27.205865 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.205881 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.205925 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:45:27.207014 (+ 1089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.207019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.207201 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.207390 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.208250 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.209222 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.210432 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.210813 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.210948 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.217628 (+ 6680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.217640 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.217659 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.217696 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.219432 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.219897 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.219901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.219902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.220010 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.220296 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.220298 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.220299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.220827 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.220961 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.221357 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.221631 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":447,"spinlock_wait_cycles":14720,"thread_start_us":173,"threads_started":1}
I20260809 15:45:27.224997 15699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:27.225786 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.225493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36908)
0809 15:45:27.225641 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.225722 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 15:45:27.226116 15611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
Entry for principal kudu/127.14.15.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab.
I20260809 15:45:27.227188 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.226903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36918)
0809 15:45:27.227061 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.227120 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 15:45:27.227342 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:38535: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
I20260809 15:45:27.227720 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:38535
--webserver_interface=127.14.15.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:45:27.276623 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } attempt: 1
I20260809 15:45:27.277575 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.277251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36924)
0809 15:45:27.277412 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.277489 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 15:45:27.278400 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.278123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36926)
0809 15:45:27.278288 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.278340 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:45:27.278545 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:38535: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
I20260809 15:45:27.346717 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } attempt: 2
I20260809 15:45:27.347678 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.347324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36932)
0809 15:45:27.347499 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.347580 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 15:45:27.348681 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.348423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36940)
0809 15:45:27.348544 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.348610 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 15:45:27.348915 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.189:38535: Network error: Client connection negotiation failed: client connection to 127.14.15.189:38535: connect: Connection refused (error 111)
W20260809 15:45:27.362088 15709 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:27.362696 15709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:27.362759 15709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:27.362869 15709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:27.370702 15709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:27.370795 15709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:27.370831 15709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:27.370872 15709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:27.370914 15709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:27.379812 15709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.189.keytab
--principal=kudu/127.14.15.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.189:38535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.15.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:27.381542 15709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:27.382946 15709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:27.393617 15721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:27.393604 15719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:27.393608 15714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:27.394296 15709 server_base.cc:1034] running on GCE node
I20260809 15:45:27.395051 15709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:27.396723 15709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:27.397940 15709 hybrid_clock.cc:648] HybridClock initialized: now 1786290327397913 us; error 44 us; skew 500 ppm
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:27.401141 15709 init.cc:377] Logged in from keytab as kudu/127.14.15.189@KRBTEST.COM (short username kudu)
I20260809 15:45:27.402199 15709 webserver.cc:460] Webserver started at http://127.14.15.189:39537/ using document root <none> and password file <none>
I20260809 15:45:27.402866 15709 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:27.402966 15709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:27.403218 15709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:27.405388 15709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data/instance:
uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "186e2acc5523ef062acf5d777d9f4e57"
server_key_iv: "fd22864bcd11ae71ef4baa2626f64f2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.406003 15709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal/instance:
uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "186e2acc5523ef062acf5d777d9f4e57"
server_key_iv: "fd22864bcd11ae71ef4baa2626f64f2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.410040 15709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260809 15:45:27.412899 15731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:27.414331 15709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:27.414481 15709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal
uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "186e2acc5523ef062acf5d777d9f4e57"
server_key_iv: "fd22864bcd11ae71ef4baa2626f64f2f"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.414609 15709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:27.427852 15709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:27.430848 15709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:27.431075 15709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:27.438547 15709 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.189:38535
I20260809 15:45:27.438868 15809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.189:38535 every 8 connection(s)
I20260809 15:45:27.439677 15709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/data/info.pb
I20260809 15:45:27.440092 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } attempt: 3
I20260809 15:45:27.442718 15810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:27.446491 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15709
I20260809 15:45:27.446619 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-1/wal/instance
I20260809 15:45:27.446936 14398 external_mini_cluster.cc:1428] Setting key 324400e67f09c52c00e5775d57b5647d
I20260809 15:45:27.447242 15810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:45:27.453300 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.440714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36950)
0809 15:45:27.440879 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.440897 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.441011 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.443286 (+ 2275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.443290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.443501 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.443648 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.443656 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.444894 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.444898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.445725 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.445739 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.446561 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.446565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.446764 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.447362 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.447383 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.448689 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.451182 (+ 2493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.451186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.451188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.451400 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.451821 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.451827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.451832 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.451948 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.452718 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.452721 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.452852 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.452980 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.453130 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 15:45:27.454955 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.441387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36950 (local address 127.14.15.189:38535)
0809 15:45:27.441808 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.441833 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.441870 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:45:27.442604 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.442621 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.442998 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.443285 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.443795 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.444756 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.445860 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.446425 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.446692 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.448927 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.448935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.448951 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.448984 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.451062 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.451526 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.451532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.451538 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.451696 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.452053 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.452056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.452058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.452600 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.452737 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.453131 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.453716 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":158,"threads_started":1}
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:27.457640 15699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.15.188@KRBTEST.COM; defaulting to no policy
I20260809 15:45:27.458568 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.458240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48764)
0809 15:45:27.458444 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.458503 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 15:45:27.459297 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.459035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48778)
0809 15:45:27.459178 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.459229 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 15:45:27.459458 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.460930 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.449368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37624 (local address 127.14.15.190:41151)
0809 15:45:27.449531 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.449537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.450168 (+ 631us) server_negotiation.cc:407] Connection header received
0809 15:45:27.450423 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.450427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.450485 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.450540 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.451627 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.452337 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.453754 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.454015 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.454125 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.456528 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.456532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.456535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.456561 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.458991 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.459575 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.459578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.459580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.459665 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.459956 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.459960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.459962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.460156 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.460265 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.460657 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.460781 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:45:27.461009 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.449608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41151 (local address 127.0.0.1:37624)
0809 15:45:27.450033 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.450090 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.450291 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.450717 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.450722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.451288 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.451492 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.451504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.452475 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.452482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.453605 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.453617 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.454144 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.454149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.454296 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.454858 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.454870 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.456328 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.459103 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.459115 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.459121 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.459459 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.459761 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.459765 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.459767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.459856 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.460265 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.460273 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.460431 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.460589 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.460782 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.15.188@KRBTEST.COM" created.
I20260809 15:45:27.462014 15810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
I20260809 15:45:27.471454 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.462544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36962)
0809 15:45:27.462717 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.462730 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.462801 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.463043 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.463044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.463178 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.463271 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.463276 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.464245 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.464250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.465204 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.465220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.465697 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.465704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.465848 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.466483 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.466504 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.468065 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.469899 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.469902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.469904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.470105 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.470425 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.470428 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.470430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.470514 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.470907 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.470910 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.471004 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.471107 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.471265 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 15:45:27.471454 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.462651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36962 (local address 127.14.15.189:38535)
0809 15:45:27.462797 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.462804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.462822 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:45:27.462887 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.462892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.462948 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.463039 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.463381 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.464113 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.465340 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.465571 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.465656 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.468227 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.468231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.468232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.468254 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.469766 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.470204 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.470240 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.470242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.470323 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.470610 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.470615 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.470617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.470801 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.470907 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.471163 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.471323 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":47}
I20260809 15:45:27.472433 15810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:27.473325 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.473050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48790)
0809 15:45:27.473171 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.473254 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:45:27.473974 15733 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.475153 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.474914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48792)
0809 15:45:27.475035 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.475083 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:45:27.475329 15810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
Entry for principal kudu/127.14.15.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab.
I20260809 15:45:27.481242 14398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
/tmp/dist-test-taskBoqIL5/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:42709
--webserver_interface=127.14.15.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.15.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:45:27.490624 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 1
I20260809 15:45:27.491585 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.491172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48794)
0809 15:45:27.491380 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.491466 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 15:45:27.492456 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.492160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48796)
0809 15:45:27.492299 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.492365 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 15:45:27.492640 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.524638 15810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 1
I20260809 15:45:27.525645 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.525266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48808)
0809 15:45:27.525463 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.525544 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 15:45:27.526795 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.526454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48820)
0809 15:45:27.526620 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.526694 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 15:45:27.526997 15810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.567827 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 2
I20260809 15:45:27.568751 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.568396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48830)
0809 15:45:27.568582 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.568655 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 15:45:27.569571 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.569338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48842)
0809 15:45:27.569448 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.569504 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:45:27.569737 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.595185 15810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 2
I20260809 15:45:27.596127 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.595758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48854)
0809 15:45:27.595959 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.596029 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 15:45:27.596980 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.596720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48866)
0809 15:45:27.596853 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.596916 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 15:45:27.597164 15810 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
W20260809 15:45:27.599685 15820 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:45:27.600000 15820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:45:27.600059 15820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:45:27.600133 15820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:45:27.604305 15820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:45:27.604391 15820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:45:27.604429 15820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:45:27.604490 15820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:45:27.604521 15820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:45:27.610105 15820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.15.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.15.190:41151,127.14.15.189:38535,127.14.15.188:42709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/krb5kdc/kudu_127.14.15.188.keytab
--principal=kudu/127.14.15.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.15.188:42709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.15.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:45:27.611521 15820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:45:27.612692 15820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:45:27.621778 15829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:27.621781 15833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:45:27.621778 15830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:45:27.621822 15820 server_base.cc:1034] running on GCE node
I20260809 15:45:27.622710 15820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:45:27.623847 15820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:45:27.625025 15820 hybrid_clock.cc:648] HybridClock initialized: now 1786290327625005 us; error 32 us; skew 500 ppm
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:45:27.627960 15820 init.cc:377] Logged in from keytab as kudu/127.14.15.188@KRBTEST.COM (short username kudu)
I20260809 15:45:27.628958 15820 webserver.cc:460] Webserver started at http://127.14.15.188:34913/ using document root <none> and password file <none>
I20260809 15:45:27.629498 15820 fs_manager.cc:359] Metadata directory not provided
I20260809 15:45:27.629559 15820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:45:27.629732 15820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:45:27.631886 15820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data/instance:
uuid: "0df198ff48eb4e7896f6565436967fb0"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "34ea0c9b5c6ae4db864e3a79abe9d3c8"
server_key_iv: "031ddcbe9a09312c859cf680186f5a30"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.632423 15820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal/instance:
uuid: "0df198ff48eb4e7896f6565436967fb0"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "34ea0c9b5c6ae4db864e3a79abe9d3c8"
server_key_iv: "031ddcbe9a09312c859cf680186f5a30"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.636248 15820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:45:27.638692 15850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:45:27.640102 15820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:45:27.640277 15820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data,/tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal
uuid: "0df198ff48eb4e7896f6565436967fb0"
format_stamp: "Formatted at 2026-08-09 15:45:27 on dist-test-slave-jztv"
server_key: "34ea0c9b5c6ae4db864e3a79abe9d3c8"
server_key_iv: "031ddcbe9a09312c859cf680186f5a30"
server_key_version: "encryptionkey@0"
I20260809 15:45:27.640410 15820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:45:27.668926 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 3
I20260809 15:45:27.669870 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.669554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48882)
0809 15:45:27.669715 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.669788 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 15:45:27.670661 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.670429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48896)
0809 15:45:27.670540 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.670598 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:45:27.670822 15699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.15.188:42709: Network error: Client connection negotiation failed: client connection to 127.14.15.188:42709: connect: Connection refused (error 111)
I20260809 15:45:27.675379 15820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:45:27.678480 15820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:45:27.678646 15820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:45:27.686527 15820 rpc_server.cc:307] RPC server started. Bound to: 127.14.15.188:42709
I20260809 15:45:27.686825 15918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.15.188:42709 every 8 connection(s)
I20260809 15:45:27.687647 15820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/data/info.pb
I20260809 15:45:27.688325 15810 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 3
I20260809 15:45:27.689287 14398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu as pid 15820
I20260809 15:45:27.689471 14398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBoqIL5/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786290023600843-14398-0/minicluster-data/master-2/wal/instance
I20260809 15:45:27.689800 14398 external_mini_cluster.cc:1428] Setting key 1ec026b17640cef1ac64105381c3f9e2
I20260809 15:45:27.691314 15920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:45:27.695879 15920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.189@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
I20260809 15:45:27.703943 15817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.688909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48912)
0809 15:45:27.689115 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.689130 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.689221 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.692136 (+ 2915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.692139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.692359 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.692480 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.692488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.693790 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.693794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.694668 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.694681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.695411 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.695415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.695498 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.696050 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.696064 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.697660 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.701758 (+ 4098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.701762 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.701765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.702035 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.702444 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.702449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.702453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.702554 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.703276 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.703280 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.703408 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.703518 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.703688 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:27.704880 15923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.689928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.14.15.188:42709)
0809 15:45:27.690457 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.690478 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.690529 (+ 51us) server_negotiation.cc:407] Connection header received
0809 15:45:27.691452 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.691476 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.691850 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.692186 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.692667 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.693649 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.694796 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.695270 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.695450 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.697898 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.697907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.697942 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.697980 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.701655 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.702139 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.702145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.702151 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.702326 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.702676 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.702680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.702685 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.703108 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.704232 (+ 1124us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.704308 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.704416 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":350,"spinlock_wait_cycles":18432,"thread_start_us":150,"threads_started":1}
I20260809 15:45:27.704896 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.690468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48916 (local address 127.14.15.188:42709)
0809 15:45:27.690759 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.690768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.691075 (+ 307us) server_negotiation.cc:407] Connection header received
0809 15:45:27.691469 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.691479 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.691853 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.692184 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.693840 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.694649 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.695772 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.696132 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.696242 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.699329 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.699333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.699335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.699361 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.701640 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.702180 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.702184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.702186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.702337 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.702656 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.702660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.702661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.703104 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.703343 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.703591 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.703900 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1320,"server-negotiator.queue_time_us":233,"spinlock_wait_cycles":30848,"thread_start_us":121,"threads_started":1}
I20260809 15:45:27.708361 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.697742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.190:41151 (local address 127.0.0.1:37626)
0809 15:45:27.698156 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.698203 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.698419 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.698734 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.698743 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.699167 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.699317 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.699326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.700450 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.700453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.701045 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.701053 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.701544 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.701549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.701658 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.702517 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.702531 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.704820 (+ 2289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.706779 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.706785 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.706789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.707059 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.707401 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.707403 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.707404 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.707482 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.707916 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.707920 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.708013 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.708121 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.708248 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":112,"threads_started":1}
I20260809 15:45:27.708496 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.697806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37626 (local address 127.14.15.190:41151)
0809 15:45:27.697937 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.697942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.698312 (+ 370us) server_negotiation.cc:407] Connection header received
0809 15:45:27.698527 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.698531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.698589 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.698679 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.699508 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.700299 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.701182 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.701412 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.701528 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.704991 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.704995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.704998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.705027 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.706670 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.707192 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.707195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.707197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.707291 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.707580 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.707586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.707591 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.707809 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.707910 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.708212 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.708336 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:45:27.709395 15920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:27.709733 15810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: Bootstrap starting.
I20260809 15:45:27.712803 15810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:27.713768 15810 log.cc:824] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.190@KRBTEST.COM
I20260809 15:45:27.716575 15810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: No bootstrap required, opened a new log
I20260809 15:45:27.718679 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.709989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.14.15.189:38535)
0809 15:45:27.710106 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.710110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.710125 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:45:27.710160 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.710162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.710203 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.710311 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.710769 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.711266 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.712011 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.712239 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.712346 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.714496 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.714500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.714503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.714528 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.716261 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.716765 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.716768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.716770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.716863 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.717453 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.717457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.717459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.717795 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.717934 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.718323 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.718486 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:45:27.719241 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.709895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.189:38535 (local address 127.0.0.1:36974)
0809 15:45:27.710004 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.710020 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.710096 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.710326 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.710331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.710515 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.710629 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.710639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.711380 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.711382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.711885 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.711891 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.712357 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.712360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.712470 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.712975 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.712989 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.714342 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.716424 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.716428 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.716429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.716661 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.716966 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.716969 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.716970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.717070 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.717931 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.717934 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.718052 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.718899 (+ 847us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.719059 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 15:45:27.720074 15920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:45:27.720832 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.710727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37640 (local address 127.14.15.190:41151)
0809 15:45:27.710839 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.710843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.710855 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:45:27.710945 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.710948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.710995 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.711047 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.711904 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.712594 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.713738 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.714194 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.714332 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.716906 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.716912 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.716917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.716947 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.718780 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.719524 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.719528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.719530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.719628 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.719942 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.719946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.719947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.720170 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.720434 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.720562 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.720678 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:45:27.720873 15810 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.721149 15810 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb64f43e4fbd4c7eae2ca17805c8e3a4, State: Initialized, Role: FOLLOWER
I20260809 15:45:27.721511 15810 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.722644 15934 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.722800 15934 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.723171 15810 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.188@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.15.189@KRBTEST.COM
W20260809 15:45:27.728993 15946 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:27.729085 15946 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:27.731628 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.721015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48922)
0809 15:45:27.721262 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.721273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.721335 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.721896 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.721900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.722092 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.722197 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.722204 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.723337 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.723343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.723871 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.723879 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.724469 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.724473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.724548 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.725031 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.725044 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.726614 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.729742 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.729745 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.729747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.730319 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.730613 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.730615 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.730617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.730688 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.731147 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.731150 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.731231 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.731306 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.731467 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260809 15:45:27.732406 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.721467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48922 (local address 127.14.15.188:42709)
0809 15:45:27.721683 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.721688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.721701 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:45:27.721735 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.721738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.721784 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.721872 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.722346 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.723161 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.723998 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.724347 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.724454 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.726765 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.726769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.726772 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.726800 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.729622 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.730442 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.730445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.730447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.730522 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.730772 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.730775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.730776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.731046 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.732052 (+ 1006us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.732133 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.732258 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260809 15:45:27.728262 15709 master_runner.cc:186] Error getting master registration for 127.14.15.190:41151: OK, instance_id { permanent_uuid: "af4824282f394e458558bf6e63218354" instance_seqno: 1786290327192598 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:45:27.733057 15709 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:45:27.733282 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.722204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36980 (local address 127.14.15.189:38535)
0809 15:45:27.722334 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.722338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.722352 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:45:27.722446 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.722449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.722493 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.723312 (+ 819us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.723437 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.724149 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.725617 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.725904 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.726007 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.728990 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.728994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.728997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.729026 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.730762 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.731293 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.731297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.731298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.731392 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.731848 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.731852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.731854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.732082 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.732265 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.733020 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.733143 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 15:45:27.736135 15920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: Bootstrap starting.
I20260809 15:45:27.737584 14398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:45:27.739104 15920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:27.740041 15920 log.cc:824] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:27.738900 15656 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "af4824282f394e458558bf6e63218354"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37640
I20260809 15:45:27.742535 15920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: No bootstrap required, opened a new log
I20260809 15:45:27.746811 15920 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.747090 15920 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df198ff48eb4e7896f6565436967fb0, State: Initialized, Role: FOLLOWER
I20260809 15:45:27.747443 15920 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.748070 15950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.748275 15950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.748927 15920 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:45:27.754767 15969 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:27.754854 15969 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:27.753266 15820 master_runner.cc:186] Error getting master registration for 127.14.15.190:41151: OK, instance_id { permanent_uuid: "af4824282f394e458558bf6e63218354" instance_seqno: 1786290327192598 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:45:27.756799 15820 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:45:27.835016 15699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } attempt: 4
Aug 09 15:45:27 dist-test-slave-jztv krb5kdc[15577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786290327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.15.190@KRBTEST.COM for kudu/127.14.15.188@KRBTEST.COM
I20260809 15:45:27.845011 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.835742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48930 (local address 127.14.15.188:42709)
0809 15:45:27.835886 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.835891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.836119 (+ 228us) server_negotiation.cc:407] Connection header received
0809 15:45:27.836292 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.836299 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.836389 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.836499 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.836993 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.837789 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.838635 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.838981 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.839076 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.841629 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.841633 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.841636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.841669 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.843170 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.843676 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.843679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.843681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.843766 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.844094 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.844097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.844099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.844325 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.844419 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.844694 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.844822 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:45:27.845041 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.835674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.15.188:42709 (local address 127.0.0.1:48930)
0809 15:45:27.836038 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 15:45:27.836054 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:45:27.836174 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:45:27.836562 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:45:27.836565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:45:27.836765 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:45:27.836860 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.836865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.837893 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.837896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.838503 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:45:27.838513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.839214 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.839220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:45:27.839307 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.839891 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:45:27.839908 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:45:27.841489 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:45:27.843292 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.843297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.843300 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.843558 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.843886 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:45:27.843891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:45:27.843896 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:45:27.843993 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:45:27.844416 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:45:27.844420 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:45:27.844525 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 15:45:27.844638 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 15:45:27.844829 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278}
I20260809 15:45:27.849109 15699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: Bootstrap starting.
I20260809 15:45:27.852111 15699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: Neither blocks nor log segments found. Creating new log.
I20260809 15:45:27.853019 15699 log.cc:824] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: Log is configured to *not* fsync() on all Append() calls
I20260809 15:45:27.855312 15699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: No bootstrap required, opened a new log
I20260809 15:45:27.858506 15699 raft_consensus.cc:348] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.858757 15699 raft_consensus.cc:729] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4824282f394e458558bf6e63218354, State: Initialized, Role: FOLLOWER
I20260809 15:45:27.859102 15699 consensus_queue.cc:260] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.859680 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.859939 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.860533 15699 sys_catalog.cc:564] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:45:27.860615 15656 raft_consensus.cc:482] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 15:45:27.860713 15656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:27.862102 15656 raft_consensus.cc:504] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.863200 15656 leader_election.cc:288] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [CANDIDATE]: Term 1 election: Requested vote from peers bb64f43e4fbd4c7eae2ca17805c8e3a4 (127.14.15.189:38535), 0df198ff48eb4e7896f6565436967fb0 (127.14.15.188:42709)
I20260809 15:45:27.864114 15772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af4824282f394e458558bf6e63218354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4"
I20260809 15:45:27.864118 15888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af4824282f394e458558bf6e63218354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0df198ff48eb4e7896f6565436967fb0"
I20260809 15:45:27.864369 15888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:27.864369 15772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:45:27.865861 15888 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4824282f394e458558bf6e63218354 in term 1.
I20260809 15:45:27.866559 15772 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4824282f394e458558bf6e63218354 in term 1.
I20260809 15:45:27.867005 15611 leader_election.cc:302] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af4824282f394e458558bf6e63218354, bb64f43e4fbd4c7eae2ca17805c8e3a4; no voters:
W20260809 15:45:27.869961 15989 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:45:27.870047 15989 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:45:27.871465 15972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:45:27.871766 15972 raft_consensus.cc:686] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [term 1 LEADER]: Becoming Leader. State: Replica: af4824282f394e458558bf6e63218354, State: Running, Role: LEADER
I20260809 15:45:27.873468 15592 master_runner.cc:263] No leader master found from master af4824282f394e458558bf6e63218354
I20260809 15:45:27.873534 15592 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:45:27.872195 15972 consensus_queue.cc:237] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } }
I20260809 15:45:27.876633 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4824282f394e458558bf6e63218354. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.876816 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:27.884964 16010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:45:27.886413 16010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:45:27.892875 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.869957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36996 (local address 127.14.15.189:38535)
0809 15:45:27.870074 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.870078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.873018 (+ 2940us) server_negotiation.cc:407] Connection header received
0809 15:45:27.874528 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.874531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.874581 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.874633 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.877614 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.878631 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.881180 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.881533 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.881624 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.884850 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.884856 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.884859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.884901 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.886828 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.887806 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.887811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.887814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.887945 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.890747 (+ 2802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.890754 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.890759 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.891079 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.891229 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.892503 (+ 1274us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.892655 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:45:27.895027 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.870457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.14.15.190:41151)
0809 15:45:27.870582 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.870587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.872801 (+ 2214us) server_negotiation.cc:407] Connection header received
0809 15:45:27.873221 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.873227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.873283 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.873337 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.875593 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.876423 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.879888 (+ 3465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.880270 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.880357 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.887426 (+ 7069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.887431 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.887434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.887465 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.889447 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.890256 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.890264 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.890269 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.890372 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.891653 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.891658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.891659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.891941 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.892077 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.894697 (+ 2620us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.894841 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:45:27.898453 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:27.871364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48932 (local address 127.14.15.188:42709)
0809 15:45:27.871502 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:27.871507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:27.877264 (+ 5757us) server_negotiation.cc:407] Connection header received
0809 15:45:27.877441 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:27.877445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:27.877496 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:27.877549 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:27.882435 (+ 4886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.883341 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.886620 (+ 3279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:27.887023 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:27.887113 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:27.890342 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:45:27.890346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:45:27.890350 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:45:27.890395 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:45:27.892324 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.896861 (+ 4537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.896865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.896868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.896982 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:45:27.897351 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:45:27.897355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:45:27.897357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:45:27.897608 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:45:27.897731 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:27.898115 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 15:45:27.898290 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:45:27.901363 15888 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [term 1 FOLLOWER]: Refusing update from remote peer af4824282f394e458558bf6e63218354: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:45:27.901417 15772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [term 1 FOLLOWER]: Refusing update from remote peer af4824282f394e458558bf6e63218354: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:45:27.902146 16007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:45:27.902451 15972 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:45:27.908116 15934 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4824282f394e458558bf6e63218354. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.908253 15934 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.913707 15950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4824282f394e458558bf6e63218354. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.913857 15950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.918257 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.918495 16011 mvcc.cc:205] Tried to move back new op lower bound from 7316645183072813056 to 7316645182974861312. Current Snapshot: MvccSnapshot[applied={T|T < 7316645183072813056}]
I20260809 15:45:27.918826 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:27.920047 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.920074 15934 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.920183 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354 [sys.catalog]: This master's current role is: LEADER
I20260809 15:45:27.920199 15934 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.921746 15950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af4824282f394e458558bf6e63218354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af4824282f394e458558bf6e63218354" member_type: VOTER last_known_addr { host: "127.14.15.190" port: 41151 } } peers { permanent_uuid: "bb64f43e4fbd4c7eae2ca17805c8e3a4" member_type: VOTER last_known_addr { host: "127.14.15.189" port: 38535 } } peers { permanent_uuid: "0df198ff48eb4e7896f6565436967fb0" member_type: VOTER last_known_addr { host: "127.14.15.188" port: 42709 } } }
I20260809 15:45:27.921875 15950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:45:27.926311 16015 mvcc.cc:205] Tried to move back new op lower bound from 7316645183072813056 to 7316645182974861312. Current Snapshot: MvccSnapshot[applied={T|T < 7316645183072813056}]
I20260809 15:45:27.927184 16010 catalog_manager.cc:1347] Generated new cluster ID: 8d4894ee3f354dc6896fef6315621b4f
I20260809 15:45:27.927304 16010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
W20260809 15:45:27.932672 15739 tablet.cc:2369] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:45:27.947137 16012 mvcc.cc:205] Tried to move back new op lower bound from 7316645183072813056 to 7316645182974861312. Current Snapshot: MvccSnapshot[applied={T|T < 7316645183072813056}]
I20260809 15:45:27.960150 16010 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:45:27.961386 16010 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:45:27.973141 16010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af4824282f394e458558bf6e63218354: Generated new TSK 0
I20260809 15:45:27.974022 16010 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:45:28.007345 15706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.005703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.14.15.190:41151)
0809 15:45:28.005845 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.005850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.006102 (+ 252us) server_negotiation.cc:407] Connection header received
0809 15:45:28.006354 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.006358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.006432 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.006499 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.007187 (+ 688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37660: BlockingRecv error: recv got EOF from 127.0.0.1:37660 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 15:45:28.007506 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.006118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.14.15.189:38535)
0809 15:45:28.006297 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.006304 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.006515 (+ 211us) server_negotiation.cc:407] Connection header received
0809 15:45:28.006690 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.006694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.006752 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.006811 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.007384 (+ 573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36998: BlockingRecv error: recv got EOF from 127.0.0.1:36998 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 15:45:28.008116 15924 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.006433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48946 (local address 127.14.15.188:42709)
0809 15:45:28.006564 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.006569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.006836 (+ 267us) server_negotiation.cc:407] Connection header received
0809 15:45:28.007057 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.007062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.007117 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.007174 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.008020 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48946: BlockingRecv error: recv got EOF from 127.0.0.1:48946 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 15:45:28.011667 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.010519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37002 (local address 127.14.15.189:38535)
0809 15:45:28.010652 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.010656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.010788 (+ 132us) server_negotiation.cc:407] Connection header received
0809 15:45:28.010984 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.010986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.011063 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.011157 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.011571 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37002: BlockingRecv error: recv got EOF from 127.0.0.1:37002 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 15:45:28.015807 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.014941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37004 (local address 127.14.15.189:38535)
0809 15:45:28.015060 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.015064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.015078 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:45:28.015125 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.015127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.015168 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.015234 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.015700 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37004: BlockingRecv error: recv got EOF from 127.0.0.1:37004 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 15:45:28.021210 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.019967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37012 (local address 127.14.15.189:38535)
0809 15:45:28.020105 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.020109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.020368 (+ 259us) server_negotiation.cc:407] Connection header received
0809 15:45:28.020499 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.020501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.020546 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.020620 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.021104 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37012: BlockingRecv error: recv got EOF from 127.0.0.1:37012 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 15:45:28.028595 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.027360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37024 (local address 127.14.15.189:38535)
0809 15:45:28.027542 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.027546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.027652 (+ 106us) server_negotiation.cc:407] Connection header received
0809 15:45:28.027811 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.027813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.027860 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.027931 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.028482 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37024: BlockingRecv error: recv got EOF from 127.0.0.1:37024 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 15:45:28.040488 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.039050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37034 (local address 127.14.15.189:38535)
0809 15:45:28.039199 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.039203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.039359 (+ 156us) server_negotiation.cc:407] Connection header received
0809 15:45:28.039549 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.039553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.039606 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.039685 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.040308 (+ 623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37034: BlockingRecv error: recv got EOF from 127.0.0.1:37034 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 15:45:28.060276 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.058939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.14.15.189:38535)
0809 15:45:28.059083 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.059087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.059246 (+ 159us) server_negotiation.cc:407] Connection header received
0809 15:45:28.059428 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.059431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.059482 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.059555 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.060139 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37038: BlockingRecv error: recv got EOF from 127.0.0.1:37038 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 15:45:28.096395 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.095024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37052 (local address 127.14.15.189:38535)
0809 15:45:28.095175 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.095179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.095447 (+ 268us) server_negotiation.cc:407] Connection header received
0809 15:45:28.095578 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.095581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.095638 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.095722 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.096228 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37052: BlockingRecv error: recv got EOF from 127.0.0.1:37052 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 15:45:28.164139 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.162751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.14.15.189:38535)
0809 15:45:28.162936 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.162941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.163116 (+ 175us) server_negotiation.cc:407] Connection header received
0809 15:45:28.163331 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.163335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.163396 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.163492 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.163985 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37054: BlockingRecv error: recv got EOF from 127.0.0.1:37054 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 15:45:28.295728 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.294577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.14.15.189:38535)
0809 15:45:28.294727 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.294730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.294772 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:45:28.294930 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.294932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.294984 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.295059 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.295591 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37066: BlockingRecv error: recv got EOF from 127.0.0.1:37066 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 15:45:28.555155 15815 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:45:28.553964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37072 (local address 127.14.15.189:38535)
0809 15:45:28.554149 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:28.554153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:28.554171 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:45:28.554335 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:28.554337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:28.554391 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:28.554473 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:45:28.555020 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37072: BlockingRecv error: recv got EOF from 127.0.0.1:37072 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 15:45:28.730556 15946 catalog_manager.cc:1259] Loaded cluster ID: 8d4894ee3f354dc6896fef6315621b4f
I20260809 15:45:28.730691 15946 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: loading cluster ID for follower catalog manager: success
I20260809 15:45:28.732419 15946 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: acquiring CA information for follower catalog manager: success
I20260809 15:45:28.733668 15946 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bb64f43e4fbd4c7eae2ca17805c8e3a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:45:28.756227 15969 catalog_manager.cc:1259] Loaded cluster ID: 8d4894ee3f354dc6896fef6315621b4f
I20260809 15:45:28.756325 15969 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: loading cluster ID for follower catalog manager: success
I20260809 15:45:28.758021 15969 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: acquiring CA information for follower catalog manager: success
I20260809 15:45:28.759228 15969 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0df198ff48eb4e7896f6565436967fb0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:45:29.073271 16133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:29.069317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37084 (local address 127.14.15.189:38535)
0809 15:45:29.069588 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:29.069592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:29.069608 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:45:29.069742 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:29.069745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:29.069884 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:29.069998 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:29.070263 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.070813 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.071656 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.071890 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.071971 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:29.072322 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:29.072844 (+ 522us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:29.072952 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:29.073014 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 15:45:29.073065 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":114,"threads_started":1}
I20260809 15:45:29.080096 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:29.076455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48956 (local address 127.14.15.188:42709)
0809 15:45:29.076700 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:29.076703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:29.076717 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:45:29.076804 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:29.076806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:29.076921 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:29.077034 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:29.077251 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.077805 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.078717 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.078949 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.079038 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:29.079315 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:29.079768 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:29.079869 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:29.079920 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 15:45:29.079972 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":102,"threads_started":1}
I20260809 15:45:29.087630 16149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:29.083153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37666 (local address 127.14.15.190:41151)
0809 15:45:29.083376 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:29.083388 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:29.083578 (+ 190us) server_negotiation.cc:407] Connection header received
0809 15:45:29.083783 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:29.083790 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:29.083983 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:29.084099 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:29.084471 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.085056 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.085963 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.086193 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.086336 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:29.086666 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:29.086935 (+ 269us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:29.087034 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:29.087388 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 15:45:29.087475 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
I20260809 15:45:29.087643 16133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:29.083183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37088 (local address 127.14.15.189:38535)
0809 15:45:29.083311 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:29.083315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:29.083658 (+ 343us) server_negotiation.cc:407] Connection header received
0809 15:45:29.083846 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:29.083849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:29.083896 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:29.083942 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:29.084312 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.085124 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.086384 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.086715 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.086788 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:29.087156 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:29.087242 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:29.087335 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:29.087484 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 15:45:29.087537 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 15:45:29.087759 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:45:29.083833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48968 (local address 127.14.15.188:42709)
0809 15:45:29.083942 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:45:29.083947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:45:29.084079 (+ 132us) server_negotiation.cc:407] Connection header received
0809 15:45:29.084230 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:45:29.084234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:45:29.084305 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:45:29.084381 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:45:29.084631 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.085331 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.086503 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:45:29.086837 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:45:29.086909 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:45:29.087260 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:45:29.087342 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:45:29.087412 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 15:45:29.087550 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 15:45:29.087608 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:45:29.091207 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15592
I20260809 15:45:29.103344 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15709
I20260809 15:45:29.116762 14398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBoqIL5/build/debug/bin/kudu with pid 15820
2026-08-09T15:45:29Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3489 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6823 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (305515 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST